-- Logs begin at Tue 2022-08-30 00:17:18 UTC, end at Tue 2022-08-30 01:21:09 UTC. -- Aug 30 00:52:44.618494 dv-cinder-815146-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 00:52:44.627983 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 00:52:44.629171 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 00:52:44 2022] *** Aug 30 00:52:44.629171 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 00:52:44.629171 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 00:52:44.629171 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: nodename: dv-cinder-815146-13-iscsi Aug 30 00:52:44.629171 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: machine: x86_64 Aug 30 00:52:44.629171 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: clock source: unix Aug 30 00:52:44.629171 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: pcre jit disabled Aug 30 00:52:44.629171 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: detected number of CPU cores: 4 Aug 30 00:52:44.629171 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: current working directory: / Aug 30 00:52:44.629171 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: detected binary path: /usr/bin/uwsgi-core Aug 30 00:52:44.629171 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: your processes number limit is 47680 Aug 30 00:52:44.629171 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: your memory page size is 4096 bytes Aug 30 00:52:44.629171 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: detected max file descriptor number: 2048 Aug 30 00:52:44.629171 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: lock engine: pthread robust mutexes Aug 30 00:52:44.630035 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: thunder lock: enabled Aug 30 00:52:44.630035 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 00:52:44.630035 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 00:52:44.668522 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: Python main interpreter initialized at 0x55b85ff9b9c0 Aug 30 00:52:44.668522 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: python threads support enabled Aug 30 00:52:44.668522 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: your server socket listen backlog is limited to 100 connections Aug 30 00:52:44.668522 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: your mercy for graceful operations on workers is 90 seconds Aug 30 00:52:44.668873 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 00:52:44.668949 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: *** Operational MODE: preforking *** Aug 30 00:52:44.669187 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: *** uWSGI is running in multiple interpreter mode *** Aug 30 00:52:44.669187 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: spawned uWSGI master process (pid: 105421) Aug 30 00:52:44.669370 dv-cinder-815146-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 00:52:44.670673 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: spawned uWSGI worker 1 (pid: 105422, cores: 1) Aug 30 00:52:44.670673 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: spawned uWSGI worker 2 (pid: 105423, cores: 1) Aug 30 00:52:44.670673 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 00:52:45.331526 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 00:52:45.335113 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 00:52:46.420159 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:52:46.420159 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: from cryptography.utils import int_from_bytes Aug 30 00:52:46.420743 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:52:46.420743 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: from cryptography.utils import int_from_bytes Aug 30 00:52:46.425394 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:52:46.425394 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: from cryptography.utils import int_from_bytes Aug 30 00:52:46.426624 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:52:46.426624 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: from cryptography.utils import int_from_bytes Aug 30 00:52:48.908002 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 00:52:48.908573 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 00:52:48.908684 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 00:52:48.909031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 00:52:48.909148 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 00:52:48.909233 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 00:52:48.909381 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 00:52:48.909516 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 00:52:48.909879 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 00:52:48.909990 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.910098 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 00:52:48.910205 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.910418 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.910508 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.910738 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.910840 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.911067 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.911153 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.911377 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.911468 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.911695 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.911788 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.912011 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.912103 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.912351 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.912438 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.912601 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.912707 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.912913 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.913017 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.913238 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.913324 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815146-13-iscsi {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.913556 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.913655 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.913859 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.913949 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815146-13-iscsi {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.914167 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.914263 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.914483 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.914586 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.914787 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.914873 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.915103 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.915194 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.915406 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.915509 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.915729 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.915899 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.916035 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.916334 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.916540 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.916669 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.916853 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.916965 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.917264 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.917422 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.917505 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.917630 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.917809 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.917903 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.918123 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.918251 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.918433 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.918519 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.918756 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.918849 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.919067 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.919160 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.919392 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.919528 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815146-13-iscsi {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.919720 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.919863 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.920073 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.920156 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815146-13-iscsi {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.920387 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.920514 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.920703 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.920787 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.921020 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.921226 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.921428 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.921520 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.921749 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.921836 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.922060 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.922150 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.922365 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.922448 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.922714 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.922820 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.922994 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.923080 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.923311 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.923454 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.923630 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.923728 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.923933 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.924031 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.924241 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.924326 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.924544 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.924637 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.924853 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.924938 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.925182 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.925311 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.925593 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.925693 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.925851 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.926036 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.926161 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.926349 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.926484 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.926635 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.926804 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.926942 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.927126 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.927264 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.927401 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.927553 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.927697 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.927879 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.928016 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.928159 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.928290 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.928425 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.928560 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.928698 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.928831 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.928996 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.929156 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.929333 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.929467 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.929645 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.929775 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.929957 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.930054 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.930268 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.930353 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.930577 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.930671 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.930888 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.930975 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.931197 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.931283 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.931506 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.931600 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.931812 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.931897 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.932132 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.932223 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.932456 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.932553 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.932834 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.932938 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.933106 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.933207 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.933431 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.933532 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.933731 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.933815 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.934039 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.934122 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.934356 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.934450 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.934676 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.934768 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.934983 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.935066 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.935284 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.935374 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.935588 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.935672 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.935903 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.935988 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.936208 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.936552 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.936772 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.936868 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.937019 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.937122 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.937348 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.937441 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.937656 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.937740 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.937977 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.938070 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.938283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.938368 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.938588 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.938671 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.938897 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.938990 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.939199 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.939290 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.939503 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.939587 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.939805 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.939899 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.940107 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.940190 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.940408 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.940494 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.940714 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.940806 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.941595 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.941689 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.941930 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.942016 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.942237 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.942334 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.942541 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.942626 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.942858 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.942953 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.943169 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.943264 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.943471 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.943554 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.943777 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.943861 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.944080 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.944177 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.944383 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.944469 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.944694 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.944776 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.944994 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.945099 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.945324 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.945427 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.945646 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.945730 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.945946 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.946048 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.946249 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.946332 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.946565 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.946649 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.946871 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.946957 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.947173 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.947256 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.947490 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.947582 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.947786 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.947877 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.948088 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.948174 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.948403 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.948487 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.948703 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.948788 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.949004 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.949137 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.949330 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.949415 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.949632 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.949719 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.949937 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.950069 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.950241 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.950339 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.950541 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.950625 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.950840 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.950931 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.951143 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.951236 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.951449 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.951540 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.951753 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.951838 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.952055 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.952148 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.952356 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.952446 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.952658 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.952742 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.952973 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.953132 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.953305 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.953391 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.953614 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.953698 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.953936 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:52:48.954033 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.954272 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.954363 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.954603 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.954688 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.954933 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.955018 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.955248 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.955344 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.955558 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.955648 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.955869 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.955955 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.956194 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.956280 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.956505 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.956726 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.957439 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.957528 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.957803 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.957994 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.958077 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.958163 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.958391 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.958525 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.958706 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.958790 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.959023 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.959117 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.959338 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.959424 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.959656 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.959748 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.959967 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.960061 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.960283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.960380 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.960606 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.960699 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.960917 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.961011 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.961263 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.961352 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.961598 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.961695 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.961923 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.962020 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.962238 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.962323 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.962559 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.962642 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.962881 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.962974 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.963193 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.963284 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.963502 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.963590 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.963810 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.963908 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.964129 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.964223 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.964437 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.964527 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.964749 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.964835 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.965061 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.965177 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.965396 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.965481 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.965716 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.965801 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.966025 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.966115 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.966337 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.966423 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.966651 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.966737 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.966961 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.967047 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.967270 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.967362 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.967587 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.967679 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.967902 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.968033 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.968213 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.968308 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.968525 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.968658 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.968837 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.968922 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.969177 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.969279 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.969489 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.969574 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.969799 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.969889 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.970104 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.970239 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.970408 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.970503 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.970711 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.970803 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.971015 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.971109 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.971319 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.971411 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.971626 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.971709 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.971930 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.972015 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.972283 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.972373 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.972654 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.972748 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.972904 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.972986 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.973231 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.973321 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.973544 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.973628 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.973855 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.973942 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.974168 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.974254 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.974476 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.974578 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.974791 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.974884 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.975102 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.975186 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.975405 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.975497 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.975719 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.975813 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.976025 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.976108 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.976328 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.976425 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.976651 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.976737 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.976958 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.977042 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.977294 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.977399 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.977609 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.977695 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.977916 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.977999 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.978225 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.978322 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.978535 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.978627 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.978846 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.978933 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.979159 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.979246 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.979469 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.979555 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.979779 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.979864 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.980104 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.980225 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.980416 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.980503 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.980722 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.980808 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.981044 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.981167 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.981392 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.981488 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.981697 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.981789 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.982000 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.982083 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.982308 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.982399 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.982612 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.982711 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.982916 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.983001 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.983219 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.983304 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.983522 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.983660 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.983822 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.983908 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.984125 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.984215 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.984425 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.984517 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.984728 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.984813 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.985029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.985131 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.985374 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.985471 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.985682 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.985767 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.985985 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.986070 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.986288 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.986374 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.986589 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.986675 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.986919 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.987011 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.987222 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.987307 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.987531 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.987623 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.988468 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.988716 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.988858 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.988947 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.989038 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.989181 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.989374 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.989460 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.989692 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.989785 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.990002 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.990089 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.990314 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.990414 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.990625 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.990710 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.990937 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.991022 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.991258 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.991351 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.991568 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.991653 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.991879 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.991962 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.992187 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.992279 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.992501 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.992585 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.992810 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.992901 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.993146 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.993250 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.993453 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.993537 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.993768 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.993853 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.994085 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.994170 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.994393 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.994478 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.994709 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.994800 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.995036 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.995128 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.995346 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.995439 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.995658 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.995742 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.995967 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.996060 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.996278 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.996371 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.996587 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.996672 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.996896 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.996982 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.997229 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.997317 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.997544 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.997627 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.997855 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.997941 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.998159 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.998250 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.998474 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.998566 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.998782 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.998868 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.999092 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.999179 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.999393 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.999485 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.999707 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:48.999799 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.000024 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.000108 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.000347 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.000474 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.000644 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.000748 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.000956 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.001044 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.001300 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.001405 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.001612 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.001697 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.001922 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.002012 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.002230 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.002318 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.002535 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.002621 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.002838 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.002923 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.003147 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.003233 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.003475 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.004110 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.004306 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.004403 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.004614 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.004708 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.004918 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.005004 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.005258 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.005345 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.005569 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.005664 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.005874 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.005960 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.006177 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.006271 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.006488 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.006572 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.006809 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.006914 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.007103 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.007206 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.007420 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.007512 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.007740 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.007831 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.008044 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.008143 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.008347 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.008433 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.008668 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.008762 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.008969 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.009103 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.009299 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.009390 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.009603 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.009689 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.009911 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.009999 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.010215 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.010300 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.010521 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.010607 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.010828 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.010923 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.011143 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.011234 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.011460 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.011552 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.011764 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.011849 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.012072 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.012156 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.012413 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.012506 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.012686 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.012772 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.013011 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.013117 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.013338 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.013433 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.013642 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.013726 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.013952 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.014036 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.014263 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.014371 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.014571 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.014670 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.014876 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.014960 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.015186 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.015283 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.015491 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.015608 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.015800 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.015892 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.016110 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.016204 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.016414 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.016500 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.016722 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.016810 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.017031 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.017138 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.017366 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.017624 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.017709 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.017954 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.018050 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.018267 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.018532 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.018618 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.018875 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.018967 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.019296 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.019382 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.019627 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.019725 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.019954 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.020038 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.020265 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.020358 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.020571 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.020670 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.020881 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.021002 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.021209 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.021350 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.021516 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.021663 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.021825 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.021981 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.022129 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.022291 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.022433 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.022604 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.022735 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.022922 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.023043 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.023232 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.023347 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.023540 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.023649 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.023848 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.023953 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.024161 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.024259 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.024468 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.024553 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.024775 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.024859 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.025096 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.025197 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.025409 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.025506 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.025726 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.025818 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.026033 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.026119 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.026332 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.026415 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.026634 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.026726 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.026935 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.027023 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.027252 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.027337 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.027564 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.027656 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.027872 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.027958 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.028177 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.028270 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.028520 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.028613 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.028825 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.028915 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.029150 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.029248 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.029477 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.029579 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.029782 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.029869 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.030085 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.030176 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.030388 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.030481 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.030696 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.030788 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.031001 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.031086 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.031302 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.031389 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.031612 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.031695 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.031919 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.032007 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.032226 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.032311 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.032530 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.032613 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.032831 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.032915 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.033158 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.033247 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.033463 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.033558 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.033771 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.033855 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.034077 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.034161 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.034379 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.034463 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.034682 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.034794 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.035114 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.035207 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.035497 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.035588 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.035804 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.035899 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.036111 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.036197 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.036425 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.036510 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.036736 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.036834 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.037044 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.037202 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.037383 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.037470 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.037691 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.037783 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.038001 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.038085 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.038306 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.038396 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.038607 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.038692 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.038910 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.038994 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.039222 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.039307 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.039524 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.039613 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.039828 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.039913 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.040132 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.040222 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.040436 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.040522 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.040743 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.040871 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.041051 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.041197 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.041386 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.041479 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.041693 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.041785 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.041993 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.042090 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.042301 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.042386 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.042604 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.042696 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.042906 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.043004 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.043209 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.043301 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.043514 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.043599 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.043816 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.043910 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.044119 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.044210 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.044416 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.044499 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.044722 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.044821 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.045029 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.045130 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.045358 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.045443 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.045664 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.045751 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.045963 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.046055 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.046267 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.046351 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.046565 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.046650 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.046885 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.046969 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.047191 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.047277 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.047505 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.047591 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.047810 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.047895 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.048141 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.048224 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.048444 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.048528 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.048754 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.048844 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.049066 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.049283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.049400 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.049524 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.049704 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.049796 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.050017 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.050111 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.050855 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.051013 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.051221 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.051310 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.051530 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.051629 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.051850 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.051936 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.052163 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.052248 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.052478 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.052577 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.052785 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.052872 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.053110 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.053211 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.053438 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.053535 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.053752 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.053838 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.054054 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.054145 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.054364 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.054459 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.054675 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.054760 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.054985 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.055086 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.055291 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.055377 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.055597 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.055680 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.055906 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.055990 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.056217 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.056304 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.056526 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.056611 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.056836 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.056920 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.057169 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.057258 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.057479 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.057564 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.057785 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.057883 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.058096 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.058180 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.058397 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.058494 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.058702 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.058799 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.059010 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.059094 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.059313 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.059407 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.059616 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.059708 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.059917 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.060002 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.060227 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.060314 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.060532 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.060630 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.060840 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.060968 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.061172 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.061525 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.061739 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.061827 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.062046 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.062133 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.062413 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.062497 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.062724 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.062822 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.063039 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.063125 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.063351 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.063435 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.063655 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.063748 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.063965 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.064051 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.064283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.064375 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.064596 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.064682 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.064900 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.064993 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.065272 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.065369 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.065579 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.065664 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.065890 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.065983 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.066764 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.066880 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.067157 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.067242 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.067468 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.067555 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.067780 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.067875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.068106 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.068192 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.068413 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.068498 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.068720 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.068818 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.069026 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.069165 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.069374 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.069474 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.069680 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.069768 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.070003 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.070168 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.070418 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.070511 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.070731 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.070825 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.071038 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.071172 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.071388 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.071472 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.071713 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.071886 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.072021 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.072109 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.072334 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.072420 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.072642 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.072735 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.072963 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.073058 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.073296 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.073382 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.073605 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.073803 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.073908 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.073989 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.074213 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.074306 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.074534 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.074629 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.074855 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.074941 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.075169 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.075269 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.075475 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.075568 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.075799 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.075885 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.076121 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.076206 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.076436 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.076540 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.076758 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.076844 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.077117 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.077204 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.077427 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.077526 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.077732 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.077825 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.078039 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.078126 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.078348 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.078434 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.078652 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.078737 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.078972 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.079057 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.079275 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.079408 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.079586 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.079672 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.079896 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.079988 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.080202 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.080296 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.080508 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.080601 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.080809 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.080900 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.081149 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.081294 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.081454 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.081539 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.081873 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.082125 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.082356 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.082442 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.082689 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.082775 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.082998 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.083097 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.083326 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.083413 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.083642 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.083736 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.083955 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.084052 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.084261 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.084348 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.084566 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.084651 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.084869 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.084963 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.085208 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.085302 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.085517 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.085605 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.085824 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.085911 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.086131 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.086218 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.086466 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.086551 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.086772 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.086865 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.087092 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.087185 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.087418 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.087504 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.087741 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.087828 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.088051 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.088148 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.088382 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.088466 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.088689 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.088775 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.088995 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.089151 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.089332 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.089427 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.089641 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.089736 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.089948 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.090033 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.090251 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.090345 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.090559 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.090643 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.090862 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.090955 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.091169 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.091321 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.091472 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.091571 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.091778 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.091863 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.092082 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.092177 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.092387 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.092472 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.092691 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.092777 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.092995 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.093100 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.093328 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.093414 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.093633 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.093718 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.093945 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.094040 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.094253 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.094338 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.094559 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.094644 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.094865 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.094952 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.095188 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.095274 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.095499 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.095592 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.095816 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.095901 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.096125 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.096216 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.096440 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.096610 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.096757 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.096843 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.097089 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.097176 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.097527 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.097630 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.097850 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.097945 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.098168 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.098254 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.098486 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.098579 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.098816 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.098908 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.099112 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.099323 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.099417 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.099653 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.099747 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.099969 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.100055 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.100283 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.100551 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.100639 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.100883 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.100968 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.101235 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.101326 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.101540 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.101670 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.101851 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.101943 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.102160 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.102245 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.102473 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.102561 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.102785 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.102878 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.103099 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.103194 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.103419 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.103513 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.103733 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.103819 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.104057 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.104151 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.104372 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.104458 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.104687 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.104774 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.105003 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.105113 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.105353 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.105439 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.105671 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.105759 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.105979 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.106064 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.106292 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.106377 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.106610 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.106695 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.106929 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.107033 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.107239 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.107325 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.107551 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.107646 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.107864 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.107952 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.108178 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.108270 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.108488 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.108582 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.108797 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.108889 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.109128 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.109228 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.109449 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.109543 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.109764 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.109857 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.110075 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.110168 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.110389 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.110484 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.110703 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.110822 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.111017 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.111125 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.111334 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.111437 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.111657 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.111853 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.111975 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.112168 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.112292 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.112502 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.112593 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.113345 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.113691 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.113789 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.114009 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.114095 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.114327 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.114413 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.114656 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.114755 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.114964 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.115060 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.115270 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.115356 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.115584 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.115751 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.115882 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.116015 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.116187 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.116316 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.116507 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.116644 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.116816 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.116946 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.117142 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.117274 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.117453 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.117581 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.117762 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.117892 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.118081 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.118300 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.118436 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.118655 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.118783 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.118977 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.119113 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.119308 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.119514 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.119643 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.119859 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.119993 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.120175 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.120324 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.120503 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.120638 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.120832 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.120967 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.121156 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.121253 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.121474 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.121559 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.121786 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.121876 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.122095 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.122194 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.122403 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.122488 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.122716 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.122801 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.123027 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.123122 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.123334 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.123419 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.123640 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.123725 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.123943 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.124035 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.124253 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.124338 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.124561 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.124647 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.124867 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.124952 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.125198 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.125293 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.125510 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.125594 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.125817 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.125904 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.126122 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.126214 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.126425 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.126510 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.126730 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.126818 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.127035 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.127119 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.127338 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.127431 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.127647 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.127739 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.127950 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.128035 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.128261 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.128356 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.129210 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.129308 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.129545 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.129681 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.129897 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.130003 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.130223 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.130365 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.130530 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.130617 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.130836 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.130935 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.131153 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.131239 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.131465 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.131551 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.131791 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.131890 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.132104 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.132198 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.132414 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.132500 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.132752 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.132838 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.133084 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.133172 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.133411 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.133628 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.133727 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.133966 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.134058 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.134288 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.134373 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.134622 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.134882 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.134970 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.135219 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.135305 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.135542 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.135680 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.135848 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.135933 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.136173 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.136258 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.136484 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.136584 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.136792 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.136877 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.137119 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.137207 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.137435 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.137531 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.137747 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.137840 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.138057 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.138148 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.138367 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.138464 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.138679 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.138765 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.138986 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.139071 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.139295 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.139382 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.139603 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.139688 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.139908 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.140037 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.140216 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.140302 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.140520 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.140605 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.140827 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.140912 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.141162 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.141262 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.141473 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.141561 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.141782 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.141876 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.142098 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.142193 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.142411 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.142504 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.142724 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.142819 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.143038 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.143124 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.143349 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.143436 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.143660 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.143754 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.143972 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.144079 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.144888 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.145163 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.145315 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.145406 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.145529 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.145619 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.145847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.145943 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.146179 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.146268 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.146497 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.146583 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.146806 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.146892 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.147165 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.147263 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.147489 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.147574 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.147810 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.147905 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.148129 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.148216 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.148442 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.148526 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.148752 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.148845 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.149093 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.149181 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.149405 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.149493 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.149728 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.149823 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.150043 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.150135 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.150352 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.150443 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.150659 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.150745 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.150964 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.151050 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.151272 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.151357 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.151593 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.151724 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.151906 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.151991 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.152210 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.152311 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.152514 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.152600 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.152822 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.152908 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.153148 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.153247 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.153455 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.153542 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.153756 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.153840 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.154061 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.154160 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.154366 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.154452 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.154667 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.154758 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.154969 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.155064 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.155272 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.155395 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.155573 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.155658 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.155874 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.155972 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.156175 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.156259 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.156479 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.156570 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.156778 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.156944 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.157117 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.157206 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.157403 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.157500 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.157705 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.157791 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.158053 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.158152 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.158315 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.158409 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.158619 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.158706 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.158924 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.159010 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.159228 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.159321 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.159559 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.159645 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.159934 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.160046 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.160252 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.160856 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.161177 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.161272 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.161495 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.161581 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.161810 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.161915 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.162119 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.162221 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.162445 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.162540 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.162753 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.162848 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.163065 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.163151 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.163375 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.163461 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.163684 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.163782 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.163995 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.164090 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.164306 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.164391 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.164616 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.164709 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.164926 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.165021 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.165262 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.165351 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.165577 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.165675 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.165893 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.166000 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.166215 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.166310 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.166521 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.166608 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.166831 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.166915 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.167156 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.167251 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.167468 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.167560 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.167781 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.167867 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.168092 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.168185 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.168403 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.168488 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.168716 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.168809 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.169025 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.169141 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.169362 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.169449 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.169676 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.169769 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.169991 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.170077 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.170309 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.170407 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.170620 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.170706 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.170931 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.171019 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.171239 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.171323 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.171554 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.171639 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.171879 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.171973 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.172205 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.172305 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.172519 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.172616 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.172844 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.172932 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.173197 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.173285 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.173515 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.173617 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.173830 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.173915 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.174140 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.174226 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.174384 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 00:52:49.174483 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.174803 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.175117 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.176016 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:52:49.176281 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 00:52:49.330122 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO dbcounter [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] Registered counter for database nova_api Aug 30 00:52:49.333510 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO dbcounter [None req-923c9d59-2fe4-482f-b7d0-715fe289bbba None None] Registered counter for database nova_api Aug 30 00:52:49.351585 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_db.sqlalchemy.engines [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:52:49.353963 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_db.sqlalchemy.engines [None req-923c9d59-2fe4-482f-b7d0-715fe289bbba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105423) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:52:49.358608 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writer thread running {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:52:49.360575 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writer thread running {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:52:49.416517 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.context [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ded254c4-e178-4a36-b22b-4f767ea7accb(cell1) {{(pid=105422) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 00:52:49.418646 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.context [None req-923c9d59-2fe4-482f-b7d0-715fe289bbba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ded254c4-e178-4a36-b22b-4f767ea7accb(cell1) {{(pid=105423) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 00:52:49.420297 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:52:49.420782 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:52:49.422382 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:52:49.422491 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-923c9d59-2fe4-482f-b7d0-715fe289bbba None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:52:49.422952 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-923c9d59-2fe4-482f-b7d0-715fe289bbba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:52:49.423114 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:52:49.423558 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:52:49.424520 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-923c9d59-2fe4-482f-b7d0-715fe289bbba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:52:49.425324 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-923c9d59-2fe4-482f-b7d0-715fe289bbba None None] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:52:49.425601 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:52:49.425857 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-923c9d59-2fe4-482f-b7d0-715fe289bbba None None] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:52:49.427577 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO dbcounter [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] Registered counter for database nova_cell0 Aug 30 00:52:49.427893 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-923c9d59-2fe4-482f-b7d0-715fe289bbba None None] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:52:49.430003 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO dbcounter [None req-923c9d59-2fe4-482f-b7d0-715fe289bbba None None] Registered counter for database nova_cell0 Aug 30 00:52:49.431574 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO dbcounter [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] Registered counter for database nova_cell1 Aug 30 00:52:49.434089 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO dbcounter [None req-923c9d59-2fe4-482f-b7d0-715fe289bbba None None] Registered counter for database nova_cell1 Aug 30 00:52:49.438950 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_db.sqlalchemy.engines [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:52:49.440155 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_db.sqlalchemy.engines [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:52:49.442318 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_db.sqlalchemy.engines [None req-923c9d59-2fe4-482f-b7d0-715fe289bbba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105423) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:52:49.443620 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_db.sqlalchemy.engines [None req-923c9d59-2fe4-482f-b7d0-715fe289bbba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105423) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:52:49.448378 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writer thread running {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:52:49.448712 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writer thread running {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:52:49.451381 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writer thread running {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:52:49.451818 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writer thread running {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:52:49.593762 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO dbcounter [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] Registered counter for database nova_cell0 Aug 30 00:52:49.598828 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO dbcounter [None req-923c9d59-2fe4-482f-b7d0-715fe289bbba None None] Registered counter for database nova_cell0 Aug 30 00:52:49.602876 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_db.sqlalchemy.engines [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:52:49.607410 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_db.sqlalchemy.engines [None req-923c9d59-2fe4-482f-b7d0-715fe289bbba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105423) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:52:49.607667 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writer thread running {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:52:49.612183 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writer thread running {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:52:49.947081 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: WARNING keystonemiddleware.auth_token [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 00:52:49.951217 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: WARNING keystonemiddleware.auth_token [None req-923c9d59-2fe4-482f-b7d0-715fe289bbba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 00:52:49.954365 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: WARNING keystonemiddleware.auth_token [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 00:52:49.958677 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: WARNING keystonemiddleware.auth_token [None req-923c9d59-2fe4-482f-b7d0-715fe289bbba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 00:52:50.297519 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: WARNING keystonemiddleware.auth_token [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 00:52:50.303714 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: WARNING keystonemiddleware.auth_token [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 00:52:50.305240 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: WARNING keystonemiddleware.auth_token [None req-923c9d59-2fe4-482f-b7d0-715fe289bbba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 00:52:50.309011 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b85ff9b9c0 pid: 105422 (default app) Aug 30 00:52:50.311105 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:52:50.311459 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: WARNING keystonemiddleware.auth_token [None req-923c9d59-2fe4-482f-b7d0-715fe289bbba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 00:52:50.312576 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] 10.222.0.78 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001977 Aug 30 00:52:50.312991 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 788 bytes} [Tue Aug 30 00:52:50 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:52:50.317526 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b85ff9b9c0 pid: 105423 (default app) Aug 30 00:54:09.285723 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:54:09.286741 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 30 00:54:09.289154 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 2/2] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 30 00:54:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:54:09.302460 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writing DB stats nova_api:SELECT=3 {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:09.303582 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writing DB stats nova_cell1:SELECT=3 {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:09.304602 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writing DB stats nova_cell0:SELECT=3 {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:09.305757 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:10.185757 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-a577d6ce-7d7d-4504-aeb4-ec691f71cdcc admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:54:10.217726 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-a577d6ce-7d7d-4504-aeb4-ec691f71cdcc admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.920286 Aug 30 00:54:10.218504 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 1/3] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Aug 30 00:54:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:12.634027 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:54:12.635035 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-2016f64e-d221-451c-bda4-6ee2918b35ad None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Aug 30 00:54:12.635582 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 3/4] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 30 00:54:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:54:13.087242 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-a0316fa6-17d4-41d2-ab6c-4188762fbd0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "c1", "disk": 1, "vcpus": 1, "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256"}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:54:13.138095 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-a0316fa6-17d4-41d2-ab6c-4188762fbd0f admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.496043 Aug 30 00:54:13.139673 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 2/5] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Aug 30 00:54:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:54:13.153813 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writing DB stats nova_api:SELECT=3 {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:13.155662 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writing DB stats nova_cell1:SELECT=3 {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:13.156854 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writing DB stats nova_cell0:SELECT=3 {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:13.157821 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:13.371135 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-be4fd096-75c1-4bc4-b7f8-7cf6c17b1236 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:54:13.439100 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-be4fd096-75c1-4bc4-b7f8-7cf6c17b1236 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290961 Aug 30 00:54:13.439694 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 4/6] 10.222.0.78 () {64 vars in 1336 bytes} [Tue Aug 30 00:54:13 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:15.816612 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-a0316fa6-17d4-41d2-ab6c-4188762fbd0f admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:54:15.817793 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-a0316fa6-17d4-41d2-ab6c-4188762fbd0f admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001596 Aug 30 00:54:15.818109 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 3/7] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 30 00:54:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:54:16.472304 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-9ddb17e0-f2f4-414a-80eb-5d1b7e3e79df admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 5}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:54:16.512869 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-9ddb17e0-f2f4-414a-80eb-5d1b7e3e79df admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.688546 Aug 30 00:54:16.513605 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 5/8] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Aug 30 00:54:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:54:16.526666 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-2bfc2da6-d1e5-498c-bae5-60dbb8d5ecff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:54:16.563856 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-2bfc2da6-d1e5-498c-bae5-60dbb8d5ecff admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041004 Aug 30 00:54:16.564438 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 4/9] 10.222.0.78 () {64 vars in 1336 bytes} [Tue Aug 30 00:54:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:18.924278 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-9ddb17e0-f2f4-414a-80eb-5d1b7e3e79df admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:54:18.925237 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-9ddb17e0-f2f4-414a-80eb-5d1b7e3e79df admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 30 00:54:18.925663 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 6/10] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 30 00:54:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:54:19.333681 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-602698d9-ccec-4d4f-ac2c-45b5eb95f703 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "ram": 1024, "rxtx_factor": 1.0, "name": "ds1G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:54:19.352569 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-602698d9-ccec-4d4f-ac2c-45b5eb95f703 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.420850 Aug 30 00:54:19.353438 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 5/11] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Aug 30 00:54:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 00:54:19.365618 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-b7c9bb10-b16e-47be-8e6a-10bb34ec3ce7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:54:19.389357 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-b7c9bb10-b16e-47be-8e6a-10bb34ec3ce7 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027313 Aug 30 00:54:19.390983 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 7/12] 10.222.0.78 () {64 vars in 1336 bytes} [Tue Aug 30 00:54:19 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:21.775069 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-602698d9-ccec-4d4f-ac2c-45b5eb95f703 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:54:21.776087 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-602698d9-ccec-4d4f-ac2c-45b5eb95f703 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 30 00:54:21.776484 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 6/13] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 30 00:54:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:54:22.241113 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-f9518587-6628-469a-8d46-3b3af25e3347 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "id": "d3", "swap": 0, "os-flavor-access:is_public": true, "name": "ds2G", "ram": 2048, "vcpus": 2}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:54:22.265328 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-f9518587-6628-469a-8d46-3b3af25e3347 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.481629 Aug 30 00:54:22.269160 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 8/14] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Aug 30 00:54:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 00:54:22.278626 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-f29ac1f8-a912-4a39-83f1-ad36dd86ba7e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:54:22.306445 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-f29ac1f8-a912-4a39-83f1-ad36dd86ba7e admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031972 Aug 30 00:54:22.307702 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 7/15] 10.222.0.78 () {64 vars in 1336 bytes} [Tue Aug 30 00:54:22 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:24.715551 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-f9518587-6628-469a-8d46-3b3af25e3347 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:54:24.716674 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-f9518587-6628-469a-8d46-3b3af25e3347 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Aug 30 00:54:24.717437 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 9/16] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 30 00:54:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:54:25.174224 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-fc5eb483-936e-45da-9648-1d88d9baf041 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4"}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:54:25.195538 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-fc5eb483-936e-45da-9648-1d88d9baf041 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.471074 Aug 30 00:54:25.196516 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 8/17] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Aug 30 00:54:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 00:54:25.209617 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-63bad269-b8c8-4728-9474-70eed0541b6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:54:25.238146 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-63bad269-b8c8-4728-9474-70eed0541b6e admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032204 Aug 30 00:54:25.239422 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 10/18] 10.222.0.78 () {64 vars in 1336 bytes} [Tue Aug 30 00:54:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:54:28.176240 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-fc5eb483-936e-45da-9648-1d88d9baf041 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:54:28.177287 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-fc5eb483-936e-45da-9648-1d88d9baf041 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001728 Aug 30 00:54:28.177688 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 9/19] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 30 00:54:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:54:28.639126 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-0593fa62-da19-4d43-9425-909942b36435 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:54:28.667551 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-0593fa62-da19-4d43-9425-909942b36435 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.483213 Aug 30 00:54:28.668177 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 11/20] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Aug 30 00:54:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:54:31.315572 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-fc5eb483-936e-45da-9648-1d88d9baf041 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:54:31.316611 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-fc5eb483-936e-45da-9648-1d88d9baf041 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 30 00:54:31.317030 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 10/21] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 30 00:54:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:54:31.769837 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-39f22868-59cf-4c3f-805a-da41058382b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "1", "disk": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny"}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:54:31.791964 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-39f22868-59cf-4c3f-805a-da41058382b1 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.468716 Aug 30 00:54:31.792522 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 12/22] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Aug 30 00:54:31 2022] POST /compute/v2.1/flavors => generated 402 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:54:31.804624 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-f6556cd4-1363-42d1-a9cf-44f0c82f3eee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:54:31.831729 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-f6556cd4-1363-42d1-a9cf-44f0c82f3eee admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030667 Aug 30 00:54:31.832296 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 11/23] 10.222.0.78 () {64 vars in 1333 bytes} [Tue Aug 30 00:54:31 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:34.200170 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-39f22868-59cf-4c3f-805a-da41058382b1 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:54:34.201493 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-39f22868-59cf-4c3f-805a-da41058382b1 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001831 Aug 30 00:54:34.201904 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 13/24] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 30 00:54:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:54:34.632636 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-783c8508-3d29-423f-927f-d4d81af02cd1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "ram": 2048, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "os-flavor-access:is_public": true, "disk": 20}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:54:34.651010 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-783c8508-3d29-423f-927f-d4d81af02cd1 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.442666 Aug 30 00:54:34.651669 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 12/25] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Aug 30 00:54:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:54:34.664380 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-a912335f-355f-4a88-a9a5-a17b9d0cab72 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:54:34.689295 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-a912335f-355f-4a88-a9a5-a17b9d0cab72 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028412 Aug 30 00:54:34.689787 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 14/26] 10.222.0.78 () {64 vars in 1333 bytes} [Tue Aug 30 00:54:34 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:37.079475 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-783c8508-3d29-423f-927f-d4d81af02cd1 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:54:37.080484 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-783c8508-3d29-423f-927f-d4d81af02cd1 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 30 00:54:37.080881 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 13/27] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 30 00:54:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:54:37.534735 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-74152588-dfc3-4c55-a283-047949d80bd6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "ram": 4096, "name": "m1.medium", "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:54:37.555631 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-74152588-dfc3-4c55-a283-047949d80bd6 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.468809 Aug 30 00:54:37.556536 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 15/28] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Aug 30 00:54:37 2022] POST /compute/v2.1/flavors => generated 406 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:54:37.569323 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-0838d889-900e-47ef-8513-044f404902a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:54:37.597048 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-0838d889-900e-47ef-8513-044f404902a6 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031391 Aug 30 00:54:37.601278 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 14/29] 10.222.0.78 () {64 vars in 1333 bytes} [Tue Aug 30 00:54:37 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:54:40.062738 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-74152588-dfc3-4c55-a283-047949d80bd6 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:54:40.063742 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-74152588-dfc3-4c55-a283-047949d80bd6 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 30 00:54:40.064142 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 16/30] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 30 00:54:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:54:40.516665 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-ef959a78-ab89-4d1d-a981-2baabf861af1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "rxtx_factor": 1.0}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:54:40.523643 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:40.538663 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-ef959a78-ab89-4d1d-a981-2baabf861af1 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.468615 Aug 30 00:54:40.539497 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 15/31] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Aug 30 00:54:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:54:40.554619 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-cc02627d-ecf4-4533-bf2e-f4b9da2ff227 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:54:40.582548 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-cc02627d-ecf4-4533-bf2e-f4b9da2ff227 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031680 Aug 30 00:54:40.583360 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 17/32] 10.222.0.78 () {64 vars in 1333 bytes} [Tue Aug 30 00:54:40 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:42.972992 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-ef959a78-ab89-4d1d-a981-2baabf861af1 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:54:42.974053 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-ef959a78-ab89-4d1d-a981-2baabf861af1 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 30 00:54:42.974455 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 16/33] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 30 00:54:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:54:43.435430 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-6faacd87-25af-4e01-8ac8-ecee6ff33422 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "ram": 16384, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "disk": 160, "swap": 0, "rxtx_factor": 1.0, "name": "m1.xlarge"}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:54:43.441401 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:43.458524 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-6faacd87-25af-4e01-8ac8-ecee6ff33422 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.478100 Aug 30 00:54:43.459310 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 18/34] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Aug 30 00:54:42 2022] POST /compute/v2.1/flavors => generated 408 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 00:54:43.472002 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-4bf8788b-99d9-4564-b90a-5961ddaf49ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:54:43.501140 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-4bf8788b-99d9-4564-b90a-5961ddaf49ac admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032659 Aug 30 00:54:43.501650 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 17/35] 10.222.0.78 () {64 vars in 1333 bytes} [Tue Aug 30 00:54:43 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:55:02.306994 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-6faacd87-25af-4e01-8ac8-ecee6ff33422 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:02.308021 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-6faacd87-25af-4e01-8ac8-ecee6ff33422 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 30 00:55:02.308416 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 19/36] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 30 00:55:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:55:02.319144 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:02.699958 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-3f6225d6-dcc2-4904-9cda-27280577be20 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:02.721632 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-3f6225d6-dcc2-4904-9cda-27280577be20 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.406942 Aug 30 00:55:02.722169 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 18/37] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Aug 30 00:55:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:55:03.778457 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-6faacd87-25af-4e01-8ac8-ecee6ff33422 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:03.779463 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-6faacd87-25af-4e01-8ac8-ecee6ff33422 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 30 00:55:03.779856 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 20/38] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Aug 30 00:55:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:55:04.300907 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-80f628f2-16a2-49f2-aa04-1930b224e054 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:04.307051 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.wsgi [None req-80f628f2-16a2-49f2-aa04-1930b224e054 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 00:55:04.310911 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-80f628f2-16a2-49f2-aa04-1930b224e054 admin admin] Request method failure captured: Aug 30 00:55:04.310911 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 00:55:04.310911 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Accept: application/json Aug 30 00:55:04.310911 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Accept-Encoding: gzip, deflate Aug 30 00:55:04.310911 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Connection: keep-alive Aug 30 00:55:04.310911 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Content-Length: 0 Aug 30 00:55:04.310911 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Host: 10.222.0.78 Aug 30 00:55:04.310911 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Openstack-Api-Version: compute 2.90 Aug 30 00:55:04.310911 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Openstack-System-Scope: None Aug 30 00:55:04.310911 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: User-Agent: python-novaclient Aug 30 00:55:04.310911 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Auth-Token: gAAAAABjDV_nBrD1wFoQlQ7tzR9z0cJY9EWJfEqFBOp819hFRakaI0AQbekG5M2aiHL64GerUCDhg8u7zNW9tO4PdqmenjHcCykBXPs6qSNCJqq9I9UL01fOlRAVJMPBU0NHlqJL13-pkRg2I9vlyCTjwdUXArskO7tP8vWWCm6bcWx6YqG3xvg Aug 30 00:55:04.310911 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Domain-Id: None Aug 30 00:55:04.310911 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Domain-Name: None Aug 30 00:55:04.310911 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Identity-Status: Confirmed Aug 30 00:55:04.310911 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Is-Admin-Project: True Aug 30 00:55:04.310911 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 00:55:04.310911 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Project-Domain-Id: default Aug 30 00:55:04.310911 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Project-Domain-Name: Default Aug 30 00:55:04.310911 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Project-Id: 761e332e13aa43bb851c08b247de0d02 Aug 30 00:55:04.310911 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Project-Name: admin Aug 30 00:55:04.310911 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Role: admin,reader,member Aug 30 00:55:04.310911 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Roles: admin,reader,member Aug 30 00:55:04.312580 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_761e332e13aa43bb851c08b247de0d02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/761e332e13aa43bb851c08b247de0d02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/761e332e13aa43bb851c08b247de0d02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/761e332e13aa43bb851c08b247de0d02"}]}] Aug 30 00:55:04.312580 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Tenant: admin Aug 30 00:55:04.312580 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Tenant-Id: 761e332e13aa43bb851c08b247de0d02 Aug 30 00:55:04.312580 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Tenant-Name: admin Aug 30 00:55:04.312580 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-User: admin Aug 30 00:55:04.312580 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-User-Domain-Id: default Aug 30 00:55:04.312580 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-User-Domain-Name: Default Aug 30 00:55:04.312580 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-User-Id: d9331e55306b44e2a9e5ecea982fbc2f Aug 30 00:55:04.312580 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-User-Name: admin Aug 30 00:55:04.312580 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: method: > Aug 30 00:55:04.312580 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: exception: Flavor 42 could not be found. Aug 30 00:55:04.312580 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: action_args: {'id': '42'} Aug 30 00:55:04.312580 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:55:04.312580 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:04.313565 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 00:55:04.313565 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 00:55:04.313565 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 00:55:04.313565 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 00:55:04.313565 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 00:55:04.313565 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 00:55:04.313565 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 00:55:04.313565 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 00:55:04.313565 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 00:55:04.313565 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:04.313565 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 00:55:04.313565 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 00:55:04.313565 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 00:55:04.313565 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Aug 30 00:55:04.313565 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:04.313565 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Aug 30 00:55:04.313565 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:04.313565 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:04.313565 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:04.314730 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:55:04.314730 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:55:04.314730 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:55:04.314730 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:04.314730 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 00:55:04.314730 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:55:04.314730 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 00:55:04.314730 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Aug 30 00:55:04.314730 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:04.314730 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Aug 30 00:55:04.314730 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:04.314730 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:04.314730 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:04.314730 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:55:04.314730 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:55:04.314730 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 00:55:04.314730 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Aug 30 00:55:04.314730 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-80f628f2-16a2-49f2-aa04-1930b224e054 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:55:04.315800 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-80f628f2-16a2-49f2-aa04-1930b224e054 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.394087 Aug 30 00:55:04.315800 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 19/39] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Aug 30 00:55:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 00:55:04.322750 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-42f217c9-24c0-404e-b4d7-00e141ba21dc admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:04.346211 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-42f217c9-24c0-404e-b4d7-00e141ba21dc admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027760 Aug 30 00:55:04.346782 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 21/40] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Aug 30 00:55:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:55:04.357466 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-22c72b88-f95e-4303-89e7-26ebf965b6da admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:04.380251 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-22c72b88-f95e-4303-89e7-26ebf965b6da admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027330 Aug 30 00:55:04.380794 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 20/41] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Aug 30 00:55:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:55:04.390178 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-1b8dd16d-f795-4317-a165-361b69a420bb admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:04.395814 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.wsgi [None req-1b8dd16d-f795-4317-a165-361b69a420bb admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 00:55:04.399029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-1b8dd16d-f795-4317-a165-361b69a420bb admin admin] Request method failure captured: Aug 30 00:55:04.399029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 00:55:04.399029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Accept: application/json Aug 30 00:55:04.399029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Accept-Encoding: gzip, deflate Aug 30 00:55:04.399029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Connection: keep-alive Aug 30 00:55:04.399029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Content-Length: 0 Aug 30 00:55:04.399029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Host: 10.222.0.78 Aug 30 00:55:04.399029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Openstack-Api-Version: compute 2.90 Aug 30 00:55:04.399029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Openstack-System-Scope: None Aug 30 00:55:04.399029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: User-Agent: python-novaclient Aug 30 00:55:04.399029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Auth-Token: gAAAAABjDV_nBrD1wFoQlQ7tzR9z0cJY9EWJfEqFBOp819hFRakaI0AQbekG5M2aiHL64GerUCDhg8u7zNW9tO4PdqmenjHcCykBXPs6qSNCJqq9I9UL01fOlRAVJMPBU0NHlqJL13-pkRg2I9vlyCTjwdUXArskO7tP8vWWCm6bcWx6YqG3xvg Aug 30 00:55:04.399029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Domain-Id: None Aug 30 00:55:04.399029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Domain-Name: None Aug 30 00:55:04.399029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Identity-Status: Confirmed Aug 30 00:55:04.399029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Is-Admin-Project: True Aug 30 00:55:04.399029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 00:55:04.399029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Project-Domain-Id: default Aug 30 00:55:04.399029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Project-Domain-Name: Default Aug 30 00:55:04.399029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Project-Id: 761e332e13aa43bb851c08b247de0d02 Aug 30 00:55:04.399029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Project-Name: admin Aug 30 00:55:04.399029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Role: admin,reader,member Aug 30 00:55:04.399029 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Roles: admin,reader,member Aug 30 00:55:04.400514 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_761e332e13aa43bb851c08b247de0d02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/761e332e13aa43bb851c08b247de0d02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/761e332e13aa43bb851c08b247de0d02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/761e332e13aa43bb851c08b247de0d02"}]}] Aug 30 00:55:04.400514 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Tenant: admin Aug 30 00:55:04.400514 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Tenant-Id: 761e332e13aa43bb851c08b247de0d02 Aug 30 00:55:04.400514 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Tenant-Name: admin Aug 30 00:55:04.400514 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-User: admin Aug 30 00:55:04.400514 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-User-Domain-Id: default Aug 30 00:55:04.400514 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-User-Domain-Name: Default Aug 30 00:55:04.400514 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-User-Id: d9331e55306b44e2a9e5ecea982fbc2f Aug 30 00:55:04.400514 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-User-Name: admin Aug 30 00:55:04.400514 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: method: > Aug 30 00:55:04.400514 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: exception: Flavor 42 could not be found. Aug 30 00:55:04.400514 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: action_args: {'id': '42'} Aug 30 00:55:04.400514 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:55:04.400514 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:04.401661 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 00:55:04.401661 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 00:55:04.401661 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 00:55:04.401661 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 00:55:04.401661 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 00:55:04.401661 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 00:55:04.401661 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 00:55:04.401661 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 00:55:04.401661 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 00:55:04.401661 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:04.401661 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 00:55:04.401661 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 00:55:04.401661 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 00:55:04.401661 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Aug 30 00:55:04.401661 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:04.401661 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Aug 30 00:55:04.401661 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:04.401661 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:04.401661 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:04.403342 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:55:04.403342 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:55:04.403342 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:55:04.403342 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:04.403342 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 00:55:04.403342 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:55:04.403342 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 00:55:04.403342 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Aug 30 00:55:04.403342 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:04.403342 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Aug 30 00:55:04.403342 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:04.403342 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:04.403342 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:04.403342 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:55:04.403342 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:55:04.403342 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 00:55:04.403342 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Aug 30 00:55:04.403342 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-1b8dd16d-f795-4317-a165-361b69a420bb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:55:04.404550 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-1b8dd16d-f795-4317-a165-361b69a420bb admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013753 Aug 30 00:55:04.404550 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 22/42] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Aug 30 00:55:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 00:55:05.388041 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-22c72b88-f95e-4303-89e7-26ebf965b6da admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:05.389061 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-22c72b88-f95e-4303-89e7-26ebf965b6da admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 30 00:55:05.389586 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 21/43] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Aug 30 00:55:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:55:05.915455 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-3be4fc31-b51f-4b3f-a487-a0389b6258f5 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:05.921531 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.wsgi [None req-3be4fc31-b51f-4b3f-a487-a0389b6258f5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 00:55:05.923031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-3be4fc31-b51f-4b3f-a487-a0389b6258f5 admin admin] Request method failure captured: Aug 30 00:55:05.923031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 00:55:05.923031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Accept: application/json Aug 30 00:55:05.923031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Accept-Encoding: gzip, deflate Aug 30 00:55:05.923031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Connection: keep-alive Aug 30 00:55:05.923031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Content-Length: 0 Aug 30 00:55:05.923031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Host: 10.222.0.78 Aug 30 00:55:05.923031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Openstack-Api-Version: compute 2.90 Aug 30 00:55:05.923031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Openstack-System-Scope: None Aug 30 00:55:05.923031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: User-Agent: python-novaclient Aug 30 00:55:05.923031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Auth-Token: gAAAAABjDV_p93LteEzQe3NIJOhpYl-eNK2EQ8edmpvH81rr2FUf3FP3BqnfWEvYFUXRXmFQw_5FJdviG_FVVDbDRToELOs7XBBNG88sCZuPozgrFRMXCppQKbW2oTJabifP1pCFvaC8hFWuVfNaEgZ858-4ep-7HsRm6Wk4BdQf-69X60l344E Aug 30 00:55:05.923031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Domain-Id: None Aug 30 00:55:05.923031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Domain-Name: None Aug 30 00:55:05.923031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Identity-Status: Confirmed Aug 30 00:55:05.923031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Is-Admin-Project: True Aug 30 00:55:05.923031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 00:55:05.923031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Project-Domain-Id: default Aug 30 00:55:05.923031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Project-Domain-Name: Default Aug 30 00:55:05.923031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Project-Id: 761e332e13aa43bb851c08b247de0d02 Aug 30 00:55:05.923031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Project-Name: admin Aug 30 00:55:05.923031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Role: admin,reader,member Aug 30 00:55:05.923031 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Roles: admin,reader,member Aug 30 00:55:05.924512 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_761e332e13aa43bb851c08b247de0d02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/761e332e13aa43bb851c08b247de0d02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/761e332e13aa43bb851c08b247de0d02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/761e332e13aa43bb851c08b247de0d02"}]}] Aug 30 00:55:05.924512 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Tenant: admin Aug 30 00:55:05.924512 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Tenant-Id: 761e332e13aa43bb851c08b247de0d02 Aug 30 00:55:05.924512 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Tenant-Name: admin Aug 30 00:55:05.924512 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-User: admin Aug 30 00:55:05.924512 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-User-Domain-Id: default Aug 30 00:55:05.924512 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-User-Domain-Name: Default Aug 30 00:55:05.924512 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-User-Id: d9331e55306b44e2a9e5ecea982fbc2f Aug 30 00:55:05.924512 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-User-Name: admin Aug 30 00:55:05.924512 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: method: > Aug 30 00:55:05.924512 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: exception: Flavor 84 could not be found. Aug 30 00:55:05.924512 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: action_args: {'id': '84'} Aug 30 00:55:05.924512 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:55:05.924512 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:05.925483 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 00:55:05.925483 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 00:55:05.925483 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 00:55:05.925483 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 00:55:05.925483 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 00:55:05.925483 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 00:55:05.925483 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 00:55:05.925483 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 00:55:05.925483 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 00:55:05.925483 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:05.925483 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 00:55:05.925483 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 00:55:05.925483 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 00:55:05.925483 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Aug 30 00:55:05.925483 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:05.925483 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Aug 30 00:55:05.925483 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:05.925483 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:05.925483 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:05.926743 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:55:05.926743 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:55:05.926743 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:55:05.926743 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:05.926743 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 00:55:05.926743 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:55:05.926743 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 00:55:05.926743 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Aug 30 00:55:05.926743 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:05.926743 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Aug 30 00:55:05.926743 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:05.926743 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:05.926743 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:05.926743 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:55:05.926743 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:55:05.926743 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 00:55:05.926743 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Aug 30 00:55:05.926743 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-3be4fc31-b51f-4b3f-a487-a0389b6258f5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:55:05.927916 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-3be4fc31-b51f-4b3f-a487-a0389b6258f5 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.395100 Aug 30 00:55:05.927916 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 23/44] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Aug 30 00:55:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 00:55:05.934997 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-799c6faf-75b3-4981-9f93-8e419b3b104d admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:05.951003 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-799c6faf-75b3-4981-9f93-8e419b3b104d admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020604 Aug 30 00:55:05.951539 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 22/45] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Aug 30 00:55:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:55:05.960814 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-f7b06d21-325b-436a-90ad-3f27f3cf7ba3 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:05.975647 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-f7b06d21-325b-436a-90ad-3f27f3cf7ba3 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018305 Aug 30 00:55:05.976164 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 24/46] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Aug 30 00:55:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:55:05.985062 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-faceba8f-7eb0-4e99-b8bb-cea3a9471d23 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:05.990337 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.wsgi [None req-faceba8f-7eb0-4e99-b8bb-cea3a9471d23 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 00:55:05.991847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-faceba8f-7eb0-4e99-b8bb-cea3a9471d23 admin admin] Request method failure captured: Aug 30 00:55:05.991847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 00:55:05.991847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Accept: application/json Aug 30 00:55:05.991847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Accept-Encoding: gzip, deflate Aug 30 00:55:05.991847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Connection: keep-alive Aug 30 00:55:05.991847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Content-Length: 0 Aug 30 00:55:05.991847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Host: 10.222.0.78 Aug 30 00:55:05.991847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Openstack-Api-Version: compute 2.90 Aug 30 00:55:05.991847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Openstack-System-Scope: None Aug 30 00:55:05.991847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: User-Agent: python-novaclient Aug 30 00:55:05.991847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Auth-Token: gAAAAABjDV_p93LteEzQe3NIJOhpYl-eNK2EQ8edmpvH81rr2FUf3FP3BqnfWEvYFUXRXmFQw_5FJdviG_FVVDbDRToELOs7XBBNG88sCZuPozgrFRMXCppQKbW2oTJabifP1pCFvaC8hFWuVfNaEgZ858-4ep-7HsRm6Wk4BdQf-69X60l344E Aug 30 00:55:05.991847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Domain-Id: None Aug 30 00:55:05.991847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Domain-Name: None Aug 30 00:55:05.991847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Identity-Status: Confirmed Aug 30 00:55:05.991847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Is-Admin-Project: True Aug 30 00:55:05.991847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 00:55:05.991847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Project-Domain-Id: default Aug 30 00:55:05.991847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Project-Domain-Name: Default Aug 30 00:55:05.991847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Project-Id: 761e332e13aa43bb851c08b247de0d02 Aug 30 00:55:05.991847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Project-Name: admin Aug 30 00:55:05.991847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Role: admin,reader,member Aug 30 00:55:05.991847 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Roles: admin,reader,member Aug 30 00:55:05.993458 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_761e332e13aa43bb851c08b247de0d02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/761e332e13aa43bb851c08b247de0d02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/761e332e13aa43bb851c08b247de0d02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/761e332e13aa43bb851c08b247de0d02"}]}] Aug 30 00:55:05.993458 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Tenant: admin Aug 30 00:55:05.993458 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Tenant-Id: 761e332e13aa43bb851c08b247de0d02 Aug 30 00:55:05.993458 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Tenant-Name: admin Aug 30 00:55:05.993458 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-User: admin Aug 30 00:55:05.993458 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-User-Domain-Id: default Aug 30 00:55:05.993458 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-User-Domain-Name: Default Aug 30 00:55:05.993458 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-User-Id: d9331e55306b44e2a9e5ecea982fbc2f Aug 30 00:55:05.993458 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-User-Name: admin Aug 30 00:55:05.993458 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: method: > Aug 30 00:55:05.993458 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: exception: Flavor 84 could not be found. Aug 30 00:55:05.993458 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: action_args: {'id': '84'} Aug 30 00:55:05.993458 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:55:05.993458 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:05.994464 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 00:55:05.994464 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 00:55:05.994464 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 00:55:05.994464 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 00:55:05.994464 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 00:55:05.994464 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 00:55:05.994464 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 00:55:05.994464 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 00:55:05.994464 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 00:55:05.994464 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:05.994464 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 00:55:05.994464 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 00:55:05.994464 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 00:55:05.994464 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Aug 30 00:55:05.994464 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:05.994464 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Aug 30 00:55:05.994464 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:05.994464 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:05.994464 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:05.996713 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:55:05.996713 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:55:05.996713 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:55:05.996713 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:05.996713 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 00:55:05.996713 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:55:05.996713 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 00:55:05.996713 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Aug 30 00:55:05.996713 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:05.996713 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Aug 30 00:55:05.996713 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:05.996713 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:05.996713 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:05.996713 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:55:05.996713 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:55:05.996713 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 00:55:05.996713 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Aug 30 00:55:05.996713 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-faceba8f-7eb0-4e99-b8bb-cea3a9471d23 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:55:05.998060 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-faceba8f-7eb0-4e99-b8bb-cea3a9471d23 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011532 Aug 30 00:55:05.998060 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 23/47] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Aug 30 00:55:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 00:55:06.956904 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-f7b06d21-325b-436a-90ad-3f27f3cf7ba3 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:06.957943 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-f7b06d21-325b-436a-90ad-3f27f3cf7ba3 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 30 00:55:06.958335 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 25/48] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Aug 30 00:55:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:55:07.479281 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-e8530f4b-8cb1-418b-9eb6-0081a28eccb8 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:07.485507 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.wsgi [None req-e8530f4b-8cb1-418b-9eb6-0081a28eccb8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 00:55:07.488005 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-e8530f4b-8cb1-418b-9eb6-0081a28eccb8 admin admin] Request method failure captured: Aug 30 00:55:07.488005 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 00:55:07.488005 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Accept: application/json Aug 30 00:55:07.488005 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Accept-Encoding: gzip, deflate Aug 30 00:55:07.488005 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Connection: keep-alive Aug 30 00:55:07.488005 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Content-Length: 0 Aug 30 00:55:07.488005 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Host: 10.222.0.78 Aug 30 00:55:07.488005 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Openstack-Api-Version: compute 2.90 Aug 30 00:55:07.488005 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Openstack-System-Scope: None Aug 30 00:55:07.488005 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: User-Agent: python-novaclient Aug 30 00:55:07.488005 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Auth-Token: gAAAAABjDV_q1hjAgV7imwDIO5_0Vlp9UJsuYIu8XC_LBJeaq0WZ4O3WHineUpD-0cBF1T6nH25zDSyhFvc6Y6EvJwuZyMQXejOORLYTtsCNgqc8gbxyHxHS_Wd2iUO-dMFyhpdxbdg5X_mZA1evIRcJCAco6HsqMwxWSUeCMbG97gp-R1NWvbo Aug 30 00:55:07.488005 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Domain-Id: None Aug 30 00:55:07.488005 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Domain-Name: None Aug 30 00:55:07.488005 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Identity-Status: Confirmed Aug 30 00:55:07.488005 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Is-Admin-Project: True Aug 30 00:55:07.488005 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 00:55:07.488005 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Project-Domain-Id: default Aug 30 00:55:07.488005 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Project-Domain-Name: Default Aug 30 00:55:07.488005 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Project-Id: 761e332e13aa43bb851c08b247de0d02 Aug 30 00:55:07.488005 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Project-Name: admin Aug 30 00:55:07.488005 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Role: admin,reader,member Aug 30 00:55:07.488005 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Roles: admin,reader,member Aug 30 00:55:07.489419 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_761e332e13aa43bb851c08b247de0d02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/761e332e13aa43bb851c08b247de0d02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/761e332e13aa43bb851c08b247de0d02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/761e332e13aa43bb851c08b247de0d02"}]}] Aug 30 00:55:07.489419 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Tenant: admin Aug 30 00:55:07.489419 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Tenant-Id: 761e332e13aa43bb851c08b247de0d02 Aug 30 00:55:07.489419 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-Tenant-Name: admin Aug 30 00:55:07.489419 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-User: admin Aug 30 00:55:07.489419 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-User-Domain-Id: default Aug 30 00:55:07.489419 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-User-Domain-Name: Default Aug 30 00:55:07.489419 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-User-Id: d9331e55306b44e2a9e5ecea982fbc2f Aug 30 00:55:07.489419 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: X-User-Name: admin Aug 30 00:55:07.489419 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: method: > Aug 30 00:55:07.489419 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: exception: Flavor 451 could not be found. Aug 30 00:55:07.489419 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: action_args: {'id': '451'} Aug 30 00:55:07.489419 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:55:07.489419 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:07.490283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 00:55:07.490283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 00:55:07.490283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 00:55:07.490283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 00:55:07.490283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 00:55:07.490283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 00:55:07.490283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 00:55:07.490283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 00:55:07.490283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 00:55:07.490283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:07.490283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 00:55:07.490283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 00:55:07.490283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 00:55:07.490283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Aug 30 00:55:07.490283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:07.490283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Aug 30 00:55:07.490283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:07.490283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:07.490283 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:07.491436 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:55:07.491436 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:55:07.491436 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:55:07.491436 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:07.491436 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 00:55:07.491436 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:55:07.491436 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 00:55:07.491436 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Aug 30 00:55:07.491436 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:07.491436 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Aug 30 00:55:07.491436 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:07.491436 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:07.491436 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:07.491436 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:55:07.491436 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:55:07.491436 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 00:55:07.491436 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Aug 30 00:55:07.491436 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-e8530f4b-8cb1-418b-9eb6-0081a28eccb8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:55:07.492464 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-e8530f4b-8cb1-418b-9eb6-0081a28eccb8 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.391471 Aug 30 00:55:07.492464 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 24/49] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Aug 30 00:55:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 00:55:07.500359 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-b6edfa66-4197-4458-b6b6-6905c13d96b1 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:07.516316 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-b6edfa66-4197-4458-b6b6-6905c13d96b1 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019892 Aug 30 00:55:07.516849 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 26/50] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Aug 30 00:55:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:55:07.526586 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-819a4e5a-5699-4c2c-a6c4-f4d485799c08 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:07.541775 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-819a4e5a-5699-4c2c-a6c4-f4d485799c08 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018832 Aug 30 00:55:07.542709 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 25/51] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Aug 30 00:55:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:55:07.551952 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-21691bb4-37fc-4e65-9501-f5bfffb36e5f admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:07.558170 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.wsgi [None req-21691bb4-37fc-4e65-9501-f5bfffb36e5f admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 00:55:07.559875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-21691bb4-37fc-4e65-9501-f5bfffb36e5f admin admin] Request method failure captured: Aug 30 00:55:07.559875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 00:55:07.559875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Accept: application/json Aug 30 00:55:07.559875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Accept-Encoding: gzip, deflate Aug 30 00:55:07.559875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Connection: keep-alive Aug 30 00:55:07.559875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Content-Length: 0 Aug 30 00:55:07.559875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Host: 10.222.0.78 Aug 30 00:55:07.559875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Openstack-Api-Version: compute 2.90 Aug 30 00:55:07.559875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Openstack-System-Scope: None Aug 30 00:55:07.559875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: User-Agent: python-novaclient Aug 30 00:55:07.559875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Auth-Token: gAAAAABjDV_q1hjAgV7imwDIO5_0Vlp9UJsuYIu8XC_LBJeaq0WZ4O3WHineUpD-0cBF1T6nH25zDSyhFvc6Y6EvJwuZyMQXejOORLYTtsCNgqc8gbxyHxHS_Wd2iUO-dMFyhpdxbdg5X_mZA1evIRcJCAco6HsqMwxWSUeCMbG97gp-R1NWvbo Aug 30 00:55:07.559875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Domain-Id: None Aug 30 00:55:07.559875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Domain-Name: None Aug 30 00:55:07.559875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Identity-Status: Confirmed Aug 30 00:55:07.559875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Is-Admin-Project: True Aug 30 00:55:07.559875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 00:55:07.559875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Project-Domain-Id: default Aug 30 00:55:07.559875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Project-Domain-Name: Default Aug 30 00:55:07.559875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Project-Id: 761e332e13aa43bb851c08b247de0d02 Aug 30 00:55:07.559875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Project-Name: admin Aug 30 00:55:07.559875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Role: admin,reader,member Aug 30 00:55:07.559875 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Roles: admin,reader,member Aug 30 00:55:07.561385 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_761e332e13aa43bb851c08b247de0d02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/761e332e13aa43bb851c08b247de0d02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/761e332e13aa43bb851c08b247de0d02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/761e332e13aa43bb851c08b247de0d02"}]}] Aug 30 00:55:07.561385 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Tenant: admin Aug 30 00:55:07.561385 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Tenant-Id: 761e332e13aa43bb851c08b247de0d02 Aug 30 00:55:07.561385 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-Tenant-Name: admin Aug 30 00:55:07.561385 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-User: admin Aug 30 00:55:07.561385 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-User-Domain-Id: default Aug 30 00:55:07.561385 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-User-Domain-Name: Default Aug 30 00:55:07.561385 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-User-Id: d9331e55306b44e2a9e5ecea982fbc2f Aug 30 00:55:07.561385 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: X-User-Name: admin Aug 30 00:55:07.561385 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: method: > Aug 30 00:55:07.561385 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: exception: Flavor 451 could not be found. Aug 30 00:55:07.561385 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: action_args: {'id': '451'} Aug 30 00:55:07.561385 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:55:07.561385 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:07.562164 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 00:55:07.562164 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 00:55:07.562164 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 00:55:07.562164 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 00:55:07.562164 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 00:55:07.562164 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 00:55:07.562164 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 00:55:07.562164 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 00:55:07.562164 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 00:55:07.562164 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:07.562164 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 00:55:07.562164 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 00:55:07.562164 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 00:55:07.562164 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Aug 30 00:55:07.562164 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:07.562164 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Aug 30 00:55:07.562164 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:07.562164 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:07.562164 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:07.563221 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:55:07.563221 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:55:07.563221 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:55:07.563221 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:07.563221 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 00:55:07.563221 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:55:07.563221 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 00:55:07.563221 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Aug 30 00:55:07.563221 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:07.563221 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Aug 30 00:55:07.563221 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:07.563221 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:07.563221 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:07.563221 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:55:07.563221 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:55:07.563221 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 00:55:07.563221 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Aug 30 00:55:07.563221 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-21691bb4-37fc-4e65-9501-f5bfffb36e5f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:55:07.564255 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-21691bb4-37fc-4e65-9501-f5bfffb36e5f admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012752 Aug 30 00:55:07.564255 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 27/52] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Aug 30 00:55:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 00:55:08.544823 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-819a4e5a-5699-4c2c-a6c4-f4d485799c08 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:08.545878 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-819a4e5a-5699-4c2c-a6c4-f4d485799c08 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 30 00:55:08.546271 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 26/53] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Aug 30 00:55:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:55:09.070627 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-e457efed-04c1-470b-8a1a-14b950250c18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:55:09.089636 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-e457efed-04c1-470b-8a1a-14b950250c18 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.404160 Aug 30 00:55:09.090072 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 28/54] 10.222.0.78 () {64 vars in 1235 bytes} [Tue Aug 30 00:55:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:55:10.061429 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-819a4e5a-5699-4c2c-a6c4-f4d485799c08 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:10.062440 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-819a4e5a-5699-4c2c-a6c4-f4d485799c08 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 30 00:55:10.062838 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 27/55] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Aug 30 00:55:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:55:10.596003 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-d3a9d29d-ff4a-420f-803e-03c21e065a98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:55:10.616848 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-d3a9d29d-ff4a-420f-803e-03c21e065a98 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.415181 Aug 30 00:55:10.617420 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 29/56] 10.222.0.78 () {64 vars in 1235 bytes} [Tue Aug 30 00:55:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:55:11.649256 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-819a4e5a-5699-4c2c-a6c4-f4d485799c08 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:11.650266 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-819a4e5a-5699-4c2c-a6c4-f4d485799c08 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 30 00:55:11.650663 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 28/57] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Aug 30 00:55:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:55:12.171036 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-a16aa69b-f155-4070-8326-1724182be820 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:55:12.190692 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-a16aa69b-f155-4070-8326-1724182be820 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.400535 Aug 30 00:55:12.191333 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 30/58] 10.222.0.78 () {64 vars in 1235 bytes} [Tue Aug 30 00:55:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:55:13.154318 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-819a4e5a-5699-4c2c-a6c4-f4d485799c08 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:13.155356 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-819a4e5a-5699-4c2c-a6c4-f4d485799c08 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 30 00:55:13.155751 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 29/59] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Aug 30 00:55:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:55:13.679193 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-78f83e48-bfc0-47b7-b0e2-b951d9fc0156 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:55:13.698179 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-78f83e48-bfc0-47b7-b0e2-b951d9fc0156 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.403315 Aug 30 00:55:13.698853 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 31/60] 10.222.0.78 () {64 vars in 1235 bytes} [Tue Aug 30 00:55:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:55:14.681043 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-819a4e5a-5699-4c2c-a6c4-f4d485799c08 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:14.682079 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-819a4e5a-5699-4c2c-a6c4-f4d485799c08 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001712 Aug 30 00:55:14.682479 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 30/61] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Aug 30 00:55:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:55:15.206036 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-488fd5c6-9434-4a37-bb5f-32507dd42cd8 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:15.226595 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-488fd5c6-9434-4a37-bb5f-32507dd42cd8 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.406260 Aug 30 00:55:15.227138 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 32/62] 10.222.0.78 () {60 vars in 1202 bytes} [Tue Aug 30 00:55:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:56:09.036334 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-819a4e5a-5699-4c2c-a6c4-f4d485799c08 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:09.037378 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-819a4e5a-5699-4c2c-a6c4-f4d485799c08 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 30 00:56:09.037776 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 31/63] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 30 00:56:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:56:09.049240 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:09.434835 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-de4efb8d-2375-4826-91cf-092e2326b944 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:09.456245 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-de4efb8d-2375-4826-91cf-092e2326b944 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.411493 Aug 30 00:56:09.456726 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 33/64] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Aug 30 00:56:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:56:09.478851 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writing DB stats nova_api:SELECT=14 {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:09.482776 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-b029b342-ca04-41e5-b0ee-cd3b042023fc admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:09.490404 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-b029b342-ca04-41e5-b0ee-cd3b042023fc admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013071 Aug 30 00:56:09.490926 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 32/65] 10.222.0.78 () {60 vars in 1283 bytes} [Tue Aug 30 00:56:09 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:56:09.503404 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-fa565e4b-3d44-433b-be41-7c411aac7554 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:09.511635 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-fa565e4b-3d44-433b-be41-7c411aac7554 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011932 Aug 30 00:56:09.512154 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 34/66] 10.222.0.78 () {60 vars in 1286 bytes} [Tue Aug 30 00:56:09 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:09.523541 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-a96b7499-ba01-47a9-9db1-ea3e3704198a admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:09.531734 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-a96b7499-ba01-47a9-9db1-ea3e3704198a admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011739 Aug 30 00:56:09.532241 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 33/67] 10.222.0.78 () {60 vars in 1286 bytes} [Tue Aug 30 00:56:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:56:09.544392 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-4c0a2343-8453-42da-9a7b-9c0702ea03c0 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:09.551912 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-4c0a2343-8453-42da-9a7b-9c0702ea03c0 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011976 Aug 30 00:56:09.552439 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 35/68] 10.222.0.78 () {60 vars in 1283 bytes} [Tue Aug 30 00:56:09 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:59:07.549866 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-a96b7499-ba01-47a9-9db1-ea3e3704198a admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:07.551080 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-a96b7499-ba01-47a9-9db1-ea3e3704198a admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Aug 30 00:59:07.552375 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 34/69] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Aug 30 00:59:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:59:07.696681 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writing DB stats nova_api:SELECT=6 {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:07.860892 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-25dccb50-b4f4-4c1e-a010-39179cc32abe admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:07.865150 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-25dccb50-b4f4-4c1e-a010-39179cc32abe admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:07.865803 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-25dccb50-b4f4-4c1e-a010-39179cc32abe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:07.866259 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-25dccb50-b4f4-4c1e-a010-39179cc32abe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:07.866977 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-25dccb50-b4f4-4c1e-a010-39179cc32abe admin admin] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:07.867423 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-25dccb50-b4f4-4c1e-a010-39179cc32abe admin admin] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:07.867843 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-25dccb50-b4f4-4c1e-a010-39179cc32abe admin admin] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:07.901374 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-25dccb50-b4f4-4c1e-a010-39179cc32abe admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.206075 Aug 30 00:59:07.901928 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 36/70] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Aug 30 00:59:07 2022] GET /compute/v2.1/os-services => generated 794 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:59:08.738138 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-a96b7499-ba01-47a9-9db1-ea3e3704198a admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:08.739410 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-a96b7499-ba01-47a9-9db1-ea3e3704198a admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 30 00:59:08.739849 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 35/71] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Aug 30 00:59:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:59:08.947259 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-76b5490c-5638-4ceb-a578-9bea59b997f6 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:08.950590 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-76b5490c-5638-4ceb-a578-9bea59b997f6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:08.951063 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-76b5490c-5638-4ceb-a578-9bea59b997f6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:08.951493 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-76b5490c-5638-4ceb-a578-9bea59b997f6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:08.952199 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-76b5490c-5638-4ceb-a578-9bea59b997f6 admin admin] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:08.952643 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-76b5490c-5638-4ceb-a578-9bea59b997f6 admin admin] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:08.953058 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-76b5490c-5638-4ceb-a578-9bea59b997f6 admin admin] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:08.975983 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-76b5490c-5638-4ceb-a578-9bea59b997f6 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.090487 Aug 30 00:59:08.976779 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 37/72] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Aug 30 00:59:08 2022] GET /compute/v2.1/os-services => generated 794 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:59:20.185634 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-a96b7499-ba01-47a9-9db1-ea3e3704198a admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:20.186640 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-a96b7499-ba01-47a9-9db1-ea3e3704198a admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 30 00:59:20.187033 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 36/73] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Aug 30 00:59:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:59:20.332912 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writing DB stats nova_cell0:SELECT=4 {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:20.334803 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writing DB stats nova_cell1:SELECT=4 {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:20.335441 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writing DB stats nova_api:SELECT=8 {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:20.383172 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-ccfce386-732b-4bf3-bb73-de0a1cbd3312 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:20.386717 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-ccfce386-732b-4bf3-bb73-de0a1cbd3312 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:20.387194 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-ccfce386-732b-4bf3-bb73-de0a1cbd3312 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:20.387621 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-ccfce386-732b-4bf3-bb73-de0a1cbd3312 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:20.388336 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-ccfce386-732b-4bf3-bb73-de0a1cbd3312 admin admin] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:20.388779 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-ccfce386-732b-4bf3-bb73-de0a1cbd3312 admin admin] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:20.389219 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-ccfce386-732b-4bf3-bb73-de0a1cbd3312 admin admin] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:20.416320 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-ccfce386-732b-4bf3-bb73-de0a1cbd3312 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.087850 Aug 30 00:59:20.416890 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 38/74] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Aug 30 00:59:20 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:59:21.257206 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-a96b7499-ba01-47a9-9db1-ea3e3704198a admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:21.258213 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-a96b7499-ba01-47a9-9db1-ea3e3704198a admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002656 Aug 30 00:59:21.258614 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 37/75] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Aug 30 00:59:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:59:21.453097 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-ccdb8eb7-dabc-43fd-8ff3-db5e64242228 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:21.456600 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-ccdb8eb7-dabc-43fd-8ff3-db5e64242228 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:21.457101 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-ccdb8eb7-dabc-43fd-8ff3-db5e64242228 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:21.457546 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-ccdb8eb7-dabc-43fd-8ff3-db5e64242228 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:21.459158 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-ccdb8eb7-dabc-43fd-8ff3-db5e64242228 admin admin] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:21.459620 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-ccdb8eb7-dabc-43fd-8ff3-db5e64242228 admin admin] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:21.460049 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-ccdb8eb7-dabc-43fd-8ff3-db5e64242228 admin admin] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:21.483162 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-ccdb8eb7-dabc-43fd-8ff3-db5e64242228 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.083152 Aug 30 00:59:21.483644 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 39/76] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Aug 30 00:59:21 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:00:18.352733 dv-cinder-815146-13-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 30 01:00:18.353662 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: Tue Aug 30 01:00:18 2022 - graceful shutdown triggered... Aug 30 01:00:18.354102 dv-cinder-815146-13-iscsi devstack@n-api.service[105422]: Gracefully killing worker 1 (pid: 105422)... Aug 30 01:00:18.354476 dv-cinder-815146-13-iscsi devstack@n-api.service[105423]: Gracefully killing worker 2 (pid: 105423)... Aug 30 01:00:19.354495 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: worker 1 buried after 1 seconds Aug 30 01:00:19.354993 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: worker 2 buried after 1 seconds Aug 30 01:00:19.354993 dv-cinder-815146-13-iscsi devstack@n-api.service[105421]: goodbye to uWSGI. Aug 30 01:00:19.356076 dv-cinder-815146-13-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 30 01:00:19.356647 dv-cinder-815146-13-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 30 01:00:19.359481 dv-cinder-815146-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 01:00:19.369248 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 01:00:19.371279 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 01:00:19 2022] *** Aug 30 01:00:19.371279 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 01:00:19.371279 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 01:00:19.371279 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: nodename: dv-cinder-815146-13-iscsi Aug 30 01:00:19.371279 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: machine: x86_64 Aug 30 01:00:19.371279 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: clock source: unix Aug 30 01:00:19.371279 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: pcre jit disabled Aug 30 01:00:19.371279 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: detected number of CPU cores: 4 Aug 30 01:00:19.371279 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: current working directory: / Aug 30 01:00:19.371279 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: detected binary path: /usr/bin/uwsgi-core Aug 30 01:00:19.371967 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: your processes number limit is 47680 Aug 30 01:00:19.371967 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: your memory page size is 4096 bytes Aug 30 01:00:19.371967 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: detected max file descriptor number: 2048 Aug 30 01:00:19.371967 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: lock engine: pthread robust mutexes Aug 30 01:00:19.371967 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: thunder lock: enabled Aug 30 01:00:19.371967 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 01:00:19.371967 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 01:00:19.412501 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: Python main interpreter initialized at 0x55d80b5d19c0 Aug 30 01:00:19.412501 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: python threads support enabled Aug 30 01:00:19.412501 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: your server socket listen backlog is limited to 100 connections Aug 30 01:00:19.412501 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: your mercy for graceful operations on workers is 90 seconds Aug 30 01:00:19.412929 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 01:00:19.412929 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: *** Operational MODE: preforking *** Aug 30 01:00:19.413239 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: *** uWSGI is running in multiple interpreter mode *** Aug 30 01:00:19.413398 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: spawned uWSGI master process (pid: 120613) Aug 30 01:00:19.413764 dv-cinder-815146-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 01:00:19.422364 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: spawned uWSGI worker 1 (pid: 120630, cores: 1) Aug 30 01:00:19.422729 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: spawned uWSGI worker 2 (pid: 120631, cores: 1) Aug 30 01:00:19.422934 dv-cinder-815146-13-iscsi devstack@n-api.service[120613]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 01:00:20.089315 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 01:00:20.092959 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 01:00:21.258979 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:00:21.258979 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: from cryptography.utils import int_from_bytes Aug 30 01:00:21.260387 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:00:21.260387 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: from cryptography.utils import int_from_bytes Aug 30 01:00:21.260541 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:00:21.260541 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: from cryptography.utils import int_from_bytes Aug 30 01:00:21.260952 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:00:21.260952 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: from cryptography.utils import int_from_bytes Aug 30 01:00:23.693044 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 01:00:23.693635 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 01:00:23.693916 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 01:00:23.694236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 01:00:23.694496 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 01:00:23.694886 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.695214 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.695541 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.695862 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.696339 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.696658 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.696982 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.697328 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.697662 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.697927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.698247 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.698572 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815146-13-iscsi {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.698896 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.700513 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.700862 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.701209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.701528 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.701864 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.702180 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.702687 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.704039 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.704039 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.704039 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.704449 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.704772 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.705110 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.705431 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.705562 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 01:00:23.705926 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 01:00:23.706006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.706085 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.706330 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 01:00:23.706454 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.706817 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 01:00:23.707092 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 01:00:23.707475 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.707796 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.708119 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.708251 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815146-13-iscsi {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.708468 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.708591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.708841 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.708950 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.709218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.709428 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.709667 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.709879 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.710107 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.710320 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.710534 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.710748 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.710958 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.711193 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.711407 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.711629 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.711782 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815146-13-iscsi {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.711964 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.712106 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.712290 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.712442 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.712588 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.712730 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.712878 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.713060 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.713246 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.713390 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.713536 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.713684 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.713832 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.713987 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.714137 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.714325 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.714523 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.714673 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.714839 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.714994 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.715156 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.715314 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.715475 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.715475 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.715776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.715933 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.716085 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.716085 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.716351 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.716551 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.716703 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.716703 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.717029 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.717222 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.717376 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.717525 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.717681 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.717830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.717830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.718116 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815146-13-iscsi {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.718262 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.718412 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.719275 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.719440 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.719602 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.719747 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.719895 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.720049 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.720192 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.720337 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.720478 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.720618 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.720766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.720921 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.721108 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.721268 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.721426 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.721574 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.721733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.721886 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.722033 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.722756 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.722917 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.723170 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.723325 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.723474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.723616 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.723757 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.723906 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.724064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.724219 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.724372 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.724520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.724520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.724791 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.724932 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.725123 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.725282 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.725429 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.725589 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.725737 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.725895 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.726057 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.726205 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.726359 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.726557 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.726710 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.726860 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.726860 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.727134 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.727278 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.727418 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.727559 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.727708 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.727862 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.728010 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.728204 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.728351 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.728506 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.728674 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.729708 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.729875 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.730035 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.730180 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.730336 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.730478 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.730640 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.730782 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.730921 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.731062 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.731229 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.731378 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.731525 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.731525 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.731798 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.731947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.732102 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.732251 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.732392 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.732550 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.732692 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.732841 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.732983 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.733158 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.733308 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.733462 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.733462 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.733751 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.733751 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.734027 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.734266 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.734460 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.734460 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.734828 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.734828 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.735114 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.735265 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.735413 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.735561 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.735814 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.735976 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.736119 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.736282 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.736430 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.736635 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.736788 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.736939 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.737112 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.737112 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.737112 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.737522 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.737662 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.737802 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.738640 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.738820 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.738820 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.739714 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.739884 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.740027 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.740178 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.740319 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.740466 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.740608 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.740608 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.740882 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.740882 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.741224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.741224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.741509 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.741658 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.741658 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.741954 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.742103 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.742103 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.742368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.742507 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.742661 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.742810 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.742950 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.743090 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.743237 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.743384 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.743538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.743696 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.743837 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.743977 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.744116 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.744116 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.744398 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.744539 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.744678 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.744819 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.744959 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.745128 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.745288 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.745448 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.745590 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.745732 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.745880 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.746033 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.746175 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.746314 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.746477 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.746627 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.746827 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.746977 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.747125 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.747272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.747437 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.747579 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.747726 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.747878 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.748019 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.748165 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.748323 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.748471 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.748611 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.748758 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.748906 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.749065 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.749556 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.749979 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.750133 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.750276 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.750425 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.750580 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.750729 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.750879 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.751020 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.751167 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.751317 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.751470 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.751619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.751771 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.751920 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.752071 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.752213 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.752452 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.752623 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.752623 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.752901 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.753048 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.753225 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.753382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.753558 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.753708 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.753870 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.754020 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.754212 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.754397 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.754538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.754679 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.754829 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.754979 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.755133 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.755282 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.755435 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.755576 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.755724 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:00:23.755881 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.756022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.756171 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.756321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.756472 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.756472 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.756801 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.756966 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.757205 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.757363 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.757514 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.757665 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.757823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.757964 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.758114 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.758255 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.758394 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.758535 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.758675 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.758823 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.758964 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.759104 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.759269 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.759767 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.760219 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.760390 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.761319 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.761489 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.761652 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.761802 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.761952 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.762108 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.762252 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.762392 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.762532 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.762674 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.762814 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.762969 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.763124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.763266 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.763414 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.763566 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.763719 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.763869 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.764010 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.764157 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.764297 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.764445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.764445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.764736 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.764887 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.765038 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.765214 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.765359 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.765511 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.765663 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.765806 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.765946 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.766092 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.766242 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.766483 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.766637 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.766786 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.766994 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.767138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.767294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.767444 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.767585 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.767724 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.767865 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.768015 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.768169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.768319 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.768459 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.768607 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.768607 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.768890 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.769041 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.769323 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.769878 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.770262 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.770553 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.770706 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.770862 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.771007 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.771148 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.771299 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.771441 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.771441 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.771871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.772033 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.772179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.772320 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.772468 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.772626 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.772768 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.772920 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.773062 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.773267 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.773406 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.773532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.773679 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.773796 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.773796 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.774019 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.774136 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.774136 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.774362 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.774471 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.774587 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.774587 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.774789 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.774911 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.775028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.775138 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.775255 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.775372 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.775491 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.775601 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.775717 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.775826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.775941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.775941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.776152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.776276 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.776400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.776510 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.776633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.776754 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.776874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.777041 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.777509 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.777671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.777815 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.777957 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.778107 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.778256 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.778405 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.778554 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.778704 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.778873 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.779024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.779024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.779298 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.779467 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.779995 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.780183 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.780488 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.780488 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.780779 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.780927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.781258 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.781426 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.781584 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.781734 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.781899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.782119 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.782272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.782423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.782566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.782720 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.782869 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.783010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.783164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.783309 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.783428 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.783545 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.783657 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.783766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.783889 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.784000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.784108 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.784215 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.784215 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.784423 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.784541 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.784652 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.785530 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.785759 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.785920 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.786072 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.786234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.786391 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.786391 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.786391 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.786822 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.787043 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.787199 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.787354 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.787354 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.787354 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.787794 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.787957 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.788106 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.788262 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.788410 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.788410 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.788697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.788860 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.789027 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.789289 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.789443 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.789570 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.789681 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.789932 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.790251 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.790251 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.790733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.790897 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.791062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.791211 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.791489 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.791489 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.791786 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.791940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.792118 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.792362 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.792535 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.792692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.792848 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.792996 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.793184 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.793337 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.793494 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.793649 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.793806 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.793961 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.794199 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.794365 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.794526 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.794675 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.794822 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.794985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.795143 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.795290 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.795438 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.795585 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.795739 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.795901 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.796056 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.796212 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.796360 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.796534 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.796720 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.796960 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.797230 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.797398 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.797544 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.797730 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.797889 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.798048 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.798197 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.798344 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.798499 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.798656 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.798824 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.799248 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.799407 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.799556 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.799703 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.799858 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.799858 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.801157 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.801329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.801511 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.801834 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.801834 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.801834 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.801834 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.802541 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.802707 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.802856 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.803010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.803168 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.803168 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.803466 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.803622 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.803622 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.803916 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.804078 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.804233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.804393 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.804549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.804705 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.804862 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.805017 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.805215 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.805366 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.805515 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.805672 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.805830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.805979 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.806132 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.806299 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.806454 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.806602 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.806780 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.807073 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.807293 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.807293 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.807590 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.807747 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.807911 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.808059 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.808206 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.808353 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.808519 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.808519 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.808816 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.808816 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.809114 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.809269 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.809429 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.809592 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.809740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.809897 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.810053 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.810324 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.810639 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.810639 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.810949 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.811269 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.811440 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.811597 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.811597 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.812000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.812000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.812000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.812440 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.812683 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.812683 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.813008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.813228 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.813387 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.813544 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.813699 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.813846 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.813994 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.814149 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.814298 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.814454 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.814601 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.814755 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.814910 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.815071 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.815071 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.815385 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.815542 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.815691 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.815837 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.816052 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.816313 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.816510 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.816686 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.816894 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.817061 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.817468 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.817659 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.817811 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.817967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.818117 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.818272 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.818272 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.818572 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.818729 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.818885 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.819040 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.819040 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.819331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.819480 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.819648 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.819803 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.819952 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.820099 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.820255 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.820499 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.820809 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.820966 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.821170 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.821484 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.821653 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.821809 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.821974 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.822232 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.822388 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.822543 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.822719 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.822937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.822937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.823232 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.823379 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.823581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.823732 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.823880 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.824027 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.824191 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.824191 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.824496 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.824658 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.824807 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.824962 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.825126 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.825126 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.825435 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.825583 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.825737 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.825885 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.826033 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.826191 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.826349 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.826498 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.826498 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.826795 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.826954 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.827112 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.827268 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.827268 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.827268 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.827744 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.827907 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.828067 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.828241 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.828391 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.828546 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.828696 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.828851 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.829011 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.829203 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.829203 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.829577 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.829730 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.829885 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.830040 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.830195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.830355 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.830531 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.830914 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.831086 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.831236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.831534 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.831758 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.831922 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.832072 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.832072 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.832498 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.832666 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.832838 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.833105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.833275 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.833433 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.833583 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.833737 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.833737 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.833737 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.834173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.834322 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.834477 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.834626 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.834782 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.834949 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.835106 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.835255 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.835409 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.835558 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.835719 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.835869 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.835869 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.836157 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.836314 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.836505 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.836677 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.836834 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.836997 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.837278 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.837442 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.837712 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.837876 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.838026 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.838176 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.838325 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.838472 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.838629 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.838779 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.838934 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.839091 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.839091 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.839389 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.839550 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.839699 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.839847 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.839994 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.840149 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.840298 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.840458 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.840615 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.840615 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.840615 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.841463 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.841792 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.841961 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.842117 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.842273 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.842422 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.842692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.842861 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.843025 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.843269 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.843434 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.843583 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.843738 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.843912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.844069 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.844224 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.844379 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.844529 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.844684 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.844841 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.844989 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.845175 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.845342 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.845499 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.845656 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.845656 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.845973 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.846122 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.846270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.846417 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.846575 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.846724 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.846888 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.847039 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.847830 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.848006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.848173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.848329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.848329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.848627 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.848776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.848923 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.849098 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.849268 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.849268 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.849268 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.849701 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.849862 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.850019 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.850167 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.850323 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.850478 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.850645 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.850809 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.850985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.851426 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.851577 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.851882 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.852053 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.852053 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.852347 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.852494 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.852649 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.852916 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.853154 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.853404 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.853562 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.853724 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.853882 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.854037 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.854200 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.854350 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.854497 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.854652 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.854808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.854957 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.855130 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.855300 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.855457 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.855605 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.855759 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.855908 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.856065 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.856220 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.856376 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.856531 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.856686 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.856834 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.856992 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.857163 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.857343 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.857498 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.857646 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.857803 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.858000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.858162 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.858318 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.858475 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.858631 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.858788 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.858938 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.859086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.859234 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.859399 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.859556 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.859717 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.859874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.860030 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.860193 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.860352 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.860502 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.860664 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.860820 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.860976 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.861271 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.861586 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.861747 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.862036 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.866083 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.866913 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.866913 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.867233 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.867402 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.867557 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.867716 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.867884 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.868129 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.868285 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.868443 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.868595 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.868754 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.868912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.869068 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.869259 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.869259 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.869552 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.869710 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.869861 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.870010 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.870215 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.870407 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.870577 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.870577 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.870880 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.871030 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.871030 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.871603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.871773 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.871933 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.872270 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.872433 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.872582 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.872582 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.872582 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.873034 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.873234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.873393 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.873549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.873747 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.873988 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.874142 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.874298 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.874448 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.874603 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.874753 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.874927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.875078 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.875234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.875391 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.875559 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.875843 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.876028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.876356 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.876741 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.876913 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.877065 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.877263 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.877433 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.877433 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.877719 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.877990 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.878165 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.878294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.878415 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.878641 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.878845 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.878951 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.879031 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.879118 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.879190 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.879190 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.879340 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.879431 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.879515 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.879606 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.879690 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.879772 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.879861 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.879954 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.880052 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.880052 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.880219 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.880310 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.880462 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.880601 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.880690 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.880774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.880863 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.880947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.881029 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.881171 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.881258 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.881341 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.881438 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.881672 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.881789 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.881876 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.881969 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.882055 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.882139 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.882373 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.882482 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.882577 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.882669 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.882754 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.882837 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.882919 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.883014 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.883100 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.883191 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.883275 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.883275 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.883434 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.883527 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.883612 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.883702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.883786 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.883868 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.883963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.884054 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.884138 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.884228 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.884311 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.884400 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.884492 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.884583 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.884666 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.884748 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.884830 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.884919 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.885018 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.885121 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.885219 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.885305 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.885388 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.885501 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.885586 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.885675 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.885760 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.885856 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.885940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.886030 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.886030 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.886195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.886423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.886516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.886600 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.886743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.886841 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.886926 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.887016 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.887103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.887186 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.887277 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.887362 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.887452 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.887544 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.887635 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.887726 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.887818 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.887911 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.887995 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.888078 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.888186 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.888280 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.888365 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.888566 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.888659 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.888887 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.888990 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.889239 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.889414 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.889561 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.889748 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.889880 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.890068 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.890234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.890401 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.890495 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.890739 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.890831 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.891054 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.891147 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.891409 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.891500 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.891737 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.891875 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.892052 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.892202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.892409 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.892623 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.892725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.892955 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.893057 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.893337 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.893451 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.893656 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.893775 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.893972 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.894893 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.894995 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.895192 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.895418 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.895659 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.895764 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.895977 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.896071 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.896312 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.896424 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.896641 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.896759 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.896972 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.897132 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.897344 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.897444 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.897657 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.897761 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.898007 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.898099 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.898327 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.898458 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.898642 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.898771 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.898956 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.899086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.899283 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.899412 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.899635 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.899756 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.899957 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.900084 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.900289 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.900408 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.900598 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.900717 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.900916 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.901043 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.901350 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.901491 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.901611 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.901730 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.901928 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.902057 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.902204 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.902336 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.902666 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.902985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.903303 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.903620 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.903850 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.903965 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.904207 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.904301 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.904538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.904631 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.904867 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.904973 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.905229 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.905350 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.905560 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.905660 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.905948 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.906048 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.906274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.906381 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.906681 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.906796 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.906962 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.907182 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.907348 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.907522 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.907673 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.907852 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.908010 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.908180 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.908331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.908501 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.908668 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.908822 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.908993 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.909260 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.909354 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.909580 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.909672 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.910538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.910637 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.910904 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.911022 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.911219 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.911312 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.911557 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.911670 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.911874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.912026 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.912192 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.912283 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.912503 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.912613 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.912828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.912939 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.913161 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.913278 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.913490 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.914249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.914357 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.914450 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.914542 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.914637 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.914730 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.914730 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.914890 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.915044 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.915136 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.915365 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.915471 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.915678 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.915772 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.916006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.916239 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.916340 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.916596 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.916755 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.916950 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.917047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.917257 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.917351 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.917568 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.917668 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.917877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.917969 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.918194 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.918287 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.918506 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.918756 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.918855 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.919084 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.919186 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.919409 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.919508 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.919733 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.919826 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.920039 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.920139 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.920347 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.920438 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.920654 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.920746 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.920968 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.921069 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.921306 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.921408 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.921617 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.921798 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.921917 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.922125 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.922219 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.922453 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.922553 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.922891 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.923107 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.923201 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.923293 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.923419 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.923513 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.923734 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.923828 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.924301 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.924414 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.924618 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.924731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.924970 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.925064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.925459 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.925590 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.925812 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.926190 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.926380 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.926514 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.926706 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.926846 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.927042 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.927160 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.927368 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.927468 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.927702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.927849 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.928024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.928125 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.928345 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.928439 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.928703 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.928802 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.929029 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.929159 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.929380 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.929602 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.929913 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.930005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.930237 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.930337 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.930580 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.930689 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.930912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.931003 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.931223 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.931314 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.931540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.931633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.931858 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.931952 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.932187 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.932281 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.932499 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.932597 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.932812 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.932918 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.933186 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.933264 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.933458 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.933551 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.933768 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.933868 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.934079 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.934170 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.934471 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.934593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.934702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.934810 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.935013 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.935154 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.935326 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.935479 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.935639 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.935949 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.936101 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.936261 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.936461 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.936573 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.936786 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.936926 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.937144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.937281 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.937484 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.937590 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.937812 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.937905 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.938130 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.938221 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.938462 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.938561 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.938774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.938866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.939085 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.939175 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.939395 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.939493 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.939709 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.939810 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.940021 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.940118 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.940340 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.940460 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.940658 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.940772 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.941011 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.941216 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.941489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.941645 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.941812 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.941968 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.942131 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.942293 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.942471 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.942654 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.942795 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.942942 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.943197 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.943300 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.943476 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.943577 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.943803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.943895 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.944119 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.944218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.944433 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.944549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.944749 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.944860 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.945061 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.945187 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.945411 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.945512 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.945725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.945821 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.946044 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.946137 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.946358 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.946459 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.946680 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.946780 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.946991 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.947096 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.947306 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.947407 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.947614 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.947701 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.947921 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.948026 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.948230 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.948323 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.948546 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.948638 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.948855 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.948960 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.949220 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.949314 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.949531 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.949634 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.949840 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.949941 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.950152 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.950245 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.950459 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.950550 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.950767 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.950859 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.951076 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.951371 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.951463 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.951677 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.951782 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.951986 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.952085 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.952303 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.952393 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.952629 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.952757 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.952918 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.953039 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.953269 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.953390 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.953578 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.953748 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.953884 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.953976 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.954220 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.954320 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.954553 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.954652 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.954873 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.954974 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.955188 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.955279 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.955502 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.955595 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.955829 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.955922 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.956142 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.956241 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.956468 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.957148 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.957362 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.957486 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.957685 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.957941 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.958035 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.958267 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.958366 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.958587 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.958680 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.958906 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.959000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.959226 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.959317 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.959537 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.959627 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.959852 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.959958 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.960164 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.960263 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.960493 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.960584 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.960826 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.960919 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.961169 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.961281 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.961500 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.961600 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.961819 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.961919 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.962141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.962233 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.962459 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.962555 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.962770 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.962860 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.963101 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.963201 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.963418 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.963531 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.963729 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.963823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.964040 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.964210 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.964354 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.964535 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.964668 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.964863 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.964977 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.965218 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.965334 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.965539 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.965638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.965868 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.965960 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.966197 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.966298 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.966515 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.966614 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.966843 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.966935 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.967157 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.967256 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.967486 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.967589 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.967814 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.967903 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.968151 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.968243 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.968467 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.968570 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.968810 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.968903 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.969165 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.969263 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.969484 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.969577 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.969797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.969903 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.970105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.970246 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.970348 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 01:00:23.970479 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.970730 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.971044 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.971362 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.971676 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.971992 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.972957 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.973489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.973775 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.974087 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.974405 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.974720 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.975121 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.975351 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.975667 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.975984 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.976296 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.976610 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.976922 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.977266 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.977580 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.977920 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.978266 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.978596 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.978929 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.979250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.979582 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.979901 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.980230 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.980560 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.980889 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.981241 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.981585 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.981904 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.982224 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.982545 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.982862 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.983181 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.983500 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.983836 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.984166 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.984479 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.984811 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.985185 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.985577 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.985904 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.986222 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.986559 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.986879 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.987197 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.987517 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.987879 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.988203 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.988531 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.988847 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.989194 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.989519 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.989840 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.990174 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.990509 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.990832 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.991165 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.991498 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.991852 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.992171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.992523 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.992855 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.993209 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.993527 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.993839 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:00:23.994084 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 01:00:24.031854 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO dbcounter [None req-e0a780d3-0f21-4758-b148-9fc7c3f4e3d2 None None] Registered counter for database nova_api Aug 30 01:00:24.053223 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_db.sqlalchemy.engines [None req-e0a780d3-0f21-4758-b148-9fc7c3f4e3d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:00:24.056254 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO dbcounter [None req-c89ff190-46cd-4f50-8bb0-504e90dc1e81 None None] Registered counter for database nova_api Aug 30 01:00:24.060057 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writer thread running {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:00:24.076326 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_db.sqlalchemy.engines [None req-c89ff190-46cd-4f50-8bb0-504e90dc1e81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120631) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:00:24.083580 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writer thread running {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:00:24.119714 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.context [None req-e0a780d3-0f21-4758-b148-9fc7c3f4e3d2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ded254c4-e178-4a36-b22b-4f767ea7accb(cell1) {{(pid=120630) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 01:00:24.123743 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e0a780d3-0f21-4758-b148-9fc7c3f4e3d2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:24.124220 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e0a780d3-0f21-4758-b148-9fc7c3f4e3d2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:24.125849 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e0a780d3-0f21-4758-b148-9fc7c3f4e3d2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:24.126581 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e0a780d3-0f21-4758-b148-9fc7c3f4e3d2 None None] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:24.127029 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e0a780d3-0f21-4758-b148-9fc7c3f4e3d2 None None] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:24.129619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e0a780d3-0f21-4758-b148-9fc7c3f4e3d2 None None] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:24.131878 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO dbcounter [None req-e0a780d3-0f21-4758-b148-9fc7c3f4e3d2 None None] Registered counter for database nova_cell0 Aug 30 01:00:24.135787 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO dbcounter [None req-e0a780d3-0f21-4758-b148-9fc7c3f4e3d2 None None] Registered counter for database nova_cell1 Aug 30 01:00:24.140929 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.context [None req-c89ff190-46cd-4f50-8bb0-504e90dc1e81 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ded254c4-e178-4a36-b22b-4f767ea7accb(cell1) {{(pid=120631) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 01:00:24.144616 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_db.sqlalchemy.engines [None req-e0a780d3-0f21-4758-b148-9fc7c3f4e3d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:00:24.146080 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c89ff190-46cd-4f50-8bb0-504e90dc1e81 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:24.146477 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_db.sqlalchemy.engines [None req-e0a780d3-0f21-4758-b148-9fc7c3f4e3d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:00:24.146579 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c89ff190-46cd-4f50-8bb0-504e90dc1e81 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:24.148217 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c89ff190-46cd-4f50-8bb0-504e90dc1e81 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:24.149055 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c89ff190-46cd-4f50-8bb0-504e90dc1e81 None None] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:24.149448 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c89ff190-46cd-4f50-8bb0-504e90dc1e81 None None] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:24.150718 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writer thread running {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:00:24.151481 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c89ff190-46cd-4f50-8bb0-504e90dc1e81 None None] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:24.153566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO dbcounter [None req-c89ff190-46cd-4f50-8bb0-504e90dc1e81 None None] Registered counter for database nova_cell0 Aug 30 01:00:24.158364 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO dbcounter [None req-c89ff190-46cd-4f50-8bb0-504e90dc1e81 None None] Registered counter for database nova_cell1 Aug 30 01:00:24.166540 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_db.sqlalchemy.engines [None req-c89ff190-46cd-4f50-8bb0-504e90dc1e81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120631) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:00:24.167909 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_db.sqlalchemy.engines [None req-c89ff190-46cd-4f50-8bb0-504e90dc1e81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120631) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:00:24.176112 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writer thread running {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:00:24.176465 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writer thread running {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:00:24.297750 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writer thread running {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:00:24.309318 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO dbcounter [None req-e0a780d3-0f21-4758-b148-9fc7c3f4e3d2 None None] Registered counter for database nova_cell0 Aug 30 01:00:24.315998 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_db.sqlalchemy.engines [None req-e0a780d3-0f21-4758-b148-9fc7c3f4e3d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:00:24.321106 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writer thread running {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:00:24.329654 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO dbcounter [None req-c89ff190-46cd-4f50-8bb0-504e90dc1e81 None None] Registered counter for database nova_cell0 Aug 30 01:00:24.338480 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_db.sqlalchemy.engines [None req-c89ff190-46cd-4f50-8bb0-504e90dc1e81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120631) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:00:24.342967 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writer thread running {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:00:24.650604 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: WARNING keystonemiddleware.auth_token [None req-e0a780d3-0f21-4758-b148-9fc7c3f4e3d2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:00:24.657911 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: WARNING keystonemiddleware.auth_token [None req-e0a780d3-0f21-4758-b148-9fc7c3f4e3d2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:00:24.671675 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: WARNING keystonemiddleware.auth_token [None req-c89ff190-46cd-4f50-8bb0-504e90dc1e81 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:00:24.679401 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: WARNING keystonemiddleware.auth_token [None req-c89ff190-46cd-4f50-8bb0-504e90dc1e81 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:00:25.016018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: WARNING keystonemiddleware.auth_token [None req-e0a780d3-0f21-4758-b148-9fc7c3f4e3d2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:00:25.022998 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: WARNING keystonemiddleware.auth_token [None req-e0a780d3-0f21-4758-b148-9fc7c3f4e3d2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:00:25.028321 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d80b5d19c0 pid: 120630 (default app) Aug 30 01:00:25.033700 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: WARNING keystonemiddleware.auth_token [None req-c89ff190-46cd-4f50-8bb0-504e90dc1e81 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:00:25.039951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: WARNING keystonemiddleware.auth_token [None req-c89ff190-46cd-4f50-8bb0-504e90dc1e81 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:00:25.045323 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d80b5d19c0 pid: 120631 (default app) Aug 30 01:01:00.147538 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=3 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:00.147538 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=3 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:00.147538 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=3 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:00.148639 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=3 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:01.105606 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8c83627f-e770-475d-a9dc-45b67f41d49e tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Action: 'create', calling method: .version_select at 0x7f0f537ace50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2076433583"}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:01.542618 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=3 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:01.544104 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=3 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:01.545164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=3 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:01.546079 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=3 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:03.173415 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-7465a97d-790e-4ed1-8cae-1f2ec1f72743 tempest-VolumesGetTestJSON-1737204110 tempest-VolumesGetTestJSON-1737204110-project] Action: 'create', calling method: .version_select at 0x7f0f537abe50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-307921998", "metadata": {"Type": "work"}}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:03.976205 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8c83627f-e770-475d-a9dc-45b67f41d49e tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.840631 Aug 30 01:01:03.986938 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 1/1] 10.222.0.78 () {60 vars in 1155 bytes} [Tue Aug 30 01:01:00 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3852 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 01:01:03.992360 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-83a29cc6-5343-43ce-a574-fefbc80e4e0f tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Calling method '.version_select at 0x7f0f53631ca0>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:04.197038 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-83a29cc6-5343-43ce-a574-fefbc80e4e0f tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/4d4761dd-d918-47bc-9ad8-14162947c27b" status: 200 len: 345 microversion: 2.1 time: 0.204752 Aug 30 01:01:04.202127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 2/2] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 30 01:01:03 2022] GET /compute/v2.1/os-volumes/4d4761dd-d918-47bc-9ad8-14162947c27b => generated 345 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:04.773699 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-7465a97d-790e-4ed1-8cae-1f2ec1f72743 tempest-VolumesGetTestJSON-1737204110 tempest-VolumesGetTestJSON-1737204110-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.244101 Aug 30 01:01:04.774930 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 1/3] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Aug 30 01:01:01 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3248 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 01:01:04.791090 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-765bb887-395a-4990-810d-82aa5d0ac6a2 tempest-VolumesGetTestJSON-1737204110 tempest-VolumesGetTestJSON-1737204110-project] Calling method '.version_select at 0x7f0f536483a0>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:04.940876 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-765bb887-395a-4990-810d-82aa5d0ac6a2 tempest-VolumesGetTestJSON-1737204110 tempest-VolumesGetTestJSON-1737204110-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6fafeb70-f5ed-4409-8d71-42e9225f7f32" status: 200 len: 352 microversion: 2.1 time: 0.153606 Aug 30 01:01:04.941647 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 3/4] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 30 01:01:04 2022] GET /compute/v2.1/os-volumes/6fafeb70-f5ed-4409-8d71-42e9225f7f32 => generated 352 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:05.215482 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-a5f9987a-0fec-446f-af7c-35f63cd00e29 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Calling method '.version_select at 0x7f0f53631ca0>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:05.325294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-a5f9987a-0fec-446f-af7c-35f63cd00e29 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/4d4761dd-d918-47bc-9ad8-14162947c27b" status: 200 len: 346 microversion: 2.1 time: 0.114088 Aug 30 01:01:05.326484 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 2/5] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 30 01:01:05 2022] GET /compute/v2.1/os-volumes/4d4761dd-d918-47bc-9ad8-14162947c27b => generated 346 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:05.340391 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-dcf4a854-fab9-418d-b72b-da9b82918d9d tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Action: 'create', calling method: .version_select at 0x7f0f53648a60>, body: {"snapshot": {"volume_id": "4d4761dd-d918-47bc-9ad8-14162947c27b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1781191521"}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:05.657287 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-dcf4a854-fab9-418d-b72b-da9b82918d9d tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] 10.222.0.78 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.321300 Aug 30 01:01:05.664474 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 4/6] 10.222.0.78 () {60 vars in 1162 bytes} [Tue Aug 30 01:01:05 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:05.669566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-a104eda2-c39e-4d46-a34e-29ac3333a4eb tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Calling method '.version_select at 0x7f0f53647430>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:05.801596 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-a104eda2-c39e-4d46-a34e-29ac3333a4eb tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/139d24a9-8fdd-43e5-ae52-c88e50e5fa92" status: 200 len: 287 microversion: 2.1 time: 0.135645 Aug 30 01:01:05.802225 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 3/7] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Aug 30 01:01:05 2022] GET /compute/v2.1/os-snapshots/139d24a9-8fdd-43e5-ae52-c88e50e5fa92 => generated 287 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:05.813728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-423d609e-7476-40d9-b793-f2d9ac63531c tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Calling method '.version_select at 0x7f0f53648e50>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:05.919591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-423d609e-7476-40d9-b793-f2d9ac63531c tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.110355 Aug 30 01:01:05.920503 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 5/8] 10.222.0.78 () {58 vars in 1140 bytes} [Tue Aug 30 01:01:05 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:05.932660 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-7cf229b4-714e-4e09-9361-16596884a7f4 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Calling method '.version_select at 0x7f0f53647b80>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:05.954758 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-d62b328c-4d1d-494a-8ff5-9ca91721dd5d tempest-VolumesGetTestJSON-1737204110 tempest-VolumesGetTestJSON-1737204110-project] Calling method '.version_select at 0x7f0f53631af0>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:06.020471 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-7cf229b4-714e-4e09-9361-16596884a7f4 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/139d24a9-8fdd-43e5-ae52-c88e50e5fa92" status: 200 len: 287 microversion: 2.1 time: 0.091674 Aug 30 01:01:06.021057 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 4/9] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Aug 30 01:01:05 2022] GET /compute/v2.1/os-snapshots/139d24a9-8fdd-43e5-ae52-c88e50e5fa92 => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:06.069862 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-d62b328c-4d1d-494a-8ff5-9ca91721dd5d tempest-VolumesGetTestJSON-1737204110 tempest-VolumesGetTestJSON-1737204110-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6fafeb70-f5ed-4409-8d71-42e9225f7f32" status: 200 len: 353 microversion: 2.1 time: 0.118900 Aug 30 01:01:06.070429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 6/10] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 30 01:01:05 2022] GET /compute/v2.1/os-volumes/6fafeb70-f5ed-4409-8d71-42e9225f7f32 => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:01:06.084276 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-107288fa-6242-42ac-b256-411a5265e09e tempest-VolumesGetTestJSON-1737204110 tempest-VolumesGetTestJSON-1737204110-project] Calling method '.version_select at 0x7f0f53631ca0>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:06.200587 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-107288fa-6242-42ac-b256-411a5265e09e tempest-VolumesGetTestJSON-1737204110 tempest-VolumesGetTestJSON-1737204110-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6fafeb70-f5ed-4409-8d71-42e9225f7f32" status: 200 len: 353 microversion: 2.1 time: 0.121469 Aug 30 01:01:06.201412 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 5/11] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 30 01:01:06 2022] GET /compute/v2.1/os-volumes/6fafeb70-f5ed-4409-8d71-42e9225f7f32 => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:06.226403 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-44c54e60-ae2b-4ee5-81cb-b1b8ef8c09d8 tempest-VolumesGetTestJSON-1737204110 tempest-VolumesGetTestJSON-1737204110-project] Calling method '.version_select at 0x7f0f535d14c0>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:06.404410 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-44c54e60-ae2b-4ee5-81cb-b1b8ef8c09d8 tempest-VolumesGetTestJSON-1737204110 tempest-VolumesGetTestJSON-1737204110-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/6fafeb70-f5ed-4409-8d71-42e9225f7f32" status: 202 len: 0 microversion: 2.1 time: 0.184306 Aug 30 01:01:06.405465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 7/12] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 30 01:01:06 2022] DELETE /compute/v2.1/os-volumes/6fafeb70-f5ed-4409-8d71-42e9225f7f32 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:01:06.415396 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-37cc6ac9-ce7f-43c6-8baf-bd53eaaf710c tempest-VolumesGetTestJSON-1737204110 tempest-VolumesGetTestJSON-1737204110-project] Calling method '.version_select at 0x7f0f53647af0>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:06.531235 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-37cc6ac9-ce7f-43c6-8baf-bd53eaaf710c tempest-VolumesGetTestJSON-1737204110 tempest-VolumesGetTestJSON-1737204110-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6fafeb70-f5ed-4409-8d71-42e9225f7f32" status: 200 len: 352 microversion: 2.1 time: 0.120889 Aug 30 01:01:06.531788 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 6/13] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 30 01:01:06 2022] GET /compute/v2.1/os-volumes/6fafeb70-f5ed-4409-8d71-42e9225f7f32 => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:07.034728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f5611db6-e838-4278-bb25-b1940d1cb216 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Calling method '.version_select at 0x7f0f53631f70>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:07.116114 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-f5611db6-e838-4278-bb25-b1940d1cb216 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/139d24a9-8fdd-43e5-ae52-c88e50e5fa92" status: 200 len: 287 microversion: 2.1 time: 0.086718 Aug 30 01:01:07.117227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 8/14] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Aug 30 01:01:07 2022] GET /compute/v2.1/os-snapshots/139d24a9-8fdd-43e5-ae52-c88e50e5fa92 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:07.555318 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-c363fdcd-7ffa-4150-ad59-76ff3292f358 tempest-VolumesGetTestJSON-1737204110 tempest-VolumesGetTestJSON-1737204110-project] Calling method '.version_select at 0x7f0f536473a0>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:07.686736 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-c363fdcd-7ffa-4150-ad59-76ff3292f358 tempest-VolumesGetTestJSON-1737204110 tempest-VolumesGetTestJSON-1737204110-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6fafeb70-f5ed-4409-8d71-42e9225f7f32" status: 200 len: 352 microversion: 2.1 time: 0.143866 Aug 30 01:01:07.688310 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 7/15] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 30 01:01:07 2022] GET /compute/v2.1/os-volumes/6fafeb70-f5ed-4409-8d71-42e9225f7f32 => generated 352 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:08.130726 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-63a13676-5d5c-4f3e-b9b1-558ca3eef6b2 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Calling method '.version_select at 0x7f0f536485e0>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:08.179091 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-63a13676-5d5c-4f3e-b9b1-558ca3eef6b2 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/139d24a9-8fdd-43e5-ae52-c88e50e5fa92" status: 200 len: 287 microversion: 2.1 time: 0.053292 Aug 30 01:01:08.179955 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 9/16] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Aug 30 01:01:08 2022] GET /compute/v2.1/os-snapshots/139d24a9-8fdd-43e5-ae52-c88e50e5fa92 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:08.703214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-004adfcc-639f-40f1-964b-129503fe3e86 tempest-VolumesGetTestJSON-1737204110 tempest-VolumesGetTestJSON-1737204110-project] Calling method '.version_select at 0x7f0f53647310>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:08.842477 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-004adfcc-639f-40f1-964b-129503fe3e86 tempest-VolumesGetTestJSON-1737204110 tempest-VolumesGetTestJSON-1737204110-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6fafeb70-f5ed-4409-8d71-42e9225f7f32" status: 200 len: 352 microversion: 2.1 time: 0.144243 Aug 30 01:01:08.843083 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 8/17] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 30 01:01:08 2022] GET /compute/v2.1/os-volumes/6fafeb70-f5ed-4409-8d71-42e9225f7f32 => generated 352 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:09.199261 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-661ece0a-14df-4e7b-960d-9ff1fcb8fcbc tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Calling method '.version_select at 0x7f0f536489d0>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:09.279670 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-661ece0a-14df-4e7b-960d-9ff1fcb8fcbc tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/139d24a9-8fdd-43e5-ae52-c88e50e5fa92" status: 200 len: 288 microversion: 2.1 time: 0.090102 Aug 30 01:01:09.280245 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 10/18] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Aug 30 01:01:09 2022] GET /compute/v2.1/os-snapshots/139d24a9-8fdd-43e5-ae52-c88e50e5fa92 => generated 288 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:09.294045 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-85805446-db58-47a3-8599-d65a50dbb158 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Calling method '.version_select at 0x7f0f53647af0>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:09.466055 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-85805446-db58-47a3-8599-d65a50dbb158 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] 10.222.0.78 "DELETE /compute/v2.1/os-snapshots/139d24a9-8fdd-43e5-ae52-c88e50e5fa92" status: 202 len: 0 microversion: 2.1 time: 0.176880 Aug 30 01:01:09.466747 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 9/19] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Aug 30 01:01:09 2022] DELETE /compute/v2.1/os-snapshots/139d24a9-8fdd-43e5-ae52-c88e50e5fa92 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:01:09.476793 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-7f508993-0500-49aa-8278-d5c550329a56 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Calling method '.version_select at 0x7f0f53648940>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:09.543597 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-7f508993-0500-49aa-8278-d5c550329a56 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/139d24a9-8fdd-43e5-ae52-c88e50e5fa92" status: 200 len: 287 microversion: 2.1 time: 0.071612 Aug 30 01:01:09.544255 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 11/20] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Aug 30 01:01:09 2022] GET /compute/v2.1/os-snapshots/139d24a9-8fdd-43e5-ae52-c88e50e5fa92 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:09.857735 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-b703d87e-4a68-4ff1-a725-6159dc812af2 tempest-VolumesGetTestJSON-1737204110 tempest-VolumesGetTestJSON-1737204110-project] Calling method '.version_select at 0x7f0f53631ca0>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:09.931693 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-b703d87e-4a68-4ff1-a725-6159dc812af2 tempest-VolumesGetTestJSON-1737204110 tempest-VolumesGetTestJSON-1737204110-project] HTTP exception thrown: Volume 6fafeb70-f5ed-4409-8d71-42e9225f7f32 could not be found. Aug 30 01:01:09.940169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-b703d87e-4a68-4ff1-a725-6159dc812af2 tempest-VolumesGetTestJSON-1737204110 tempest-VolumesGetTestJSON-1737204110-project] Request method failure captured: Aug 30 01:01:09.940169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: GET /compute/v2.1/os-volumes/6fafeb70-f5ed-4409-8d71-42e9225f7f32 HTTP/1.1 Aug 30 01:01:09.940169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:01:09.940169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:01:09.940169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:01:09.940169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:01:09.940169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:01:09.940169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:01:09.940169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:01:09.940169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:01:09.940169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWFNXSOoCt2V6MGjQMZdJxy__VdIgo0AIko4RXf8gtI3LEymp5XcWCZeGCv1lyUYTOEx23G9WGrQDedqfQMq5tMWsntmM9qGcbyjbyw6En4vk4DQlJYZ3YnKhU0yQjdB54zhBbksK1-qIN_IXYaPjeW2KqQ5eoQ-LBne1kJIcmWM_tk Aug 30 01:01:09.940169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:01:09.940169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:01:09.940169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:01:09.940169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:01:09.940169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:01:09.940169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:01:09.940169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: b5c84d6a896d4b6499dd668dcaad3783 Aug 30 01:01:09.940169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-VolumesGetTestJSON-1737204110 Aug 30 01:01:09.940169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:01:09.940169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:01:09.941993 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b5c84d6a896d4b6499dd668dcaad3783"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5c84d6a896d4b6499dd668dcaad3783"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b5c84d6a896d4b6499dd668dcaad3783"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5c84d6a896d4b6499dd668dcaad3783"}]}] Aug 30 01:01:09.941993 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-VolumesGetTestJSON-1737204110 Aug 30 01:01:09.941993 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: b5c84d6a896d4b6499dd668dcaad3783 Aug 30 01:01:09.941993 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-VolumesGetTestJSON-1737204110 Aug 30 01:01:09.941993 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-VolumesGetTestJSON-1737204110-project Aug 30 01:01:09.941993 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:01:09.941993 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:01:09.941993 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: 44d911e3e6254ec29df39a460220efd2 Aug 30 01:01:09.941993 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-VolumesGetTestJSON-1737204110-project Aug 30 01:01:09.941993 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: Aug 30 01:01:09.941993 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Volume 6fafeb70-f5ed-4409-8d71-42e9225f7f32 could not be found. Aug 30 01:01:09.941993 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': '6fafeb70-f5ed-4409-8d71-42e9225f7f32'} Aug 30 01:01:09.941993 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:01:09.942740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:09.942740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:01:09.942740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:01:09.942740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:01:09.942740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:01:09.942740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:01:09.942740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:01:09.942740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:01:09.942740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:01:09.942740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:01:09.942740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:01:09.942740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:01:09.942740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:01:09.942740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:01:09.942740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:01:09.942740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6fafeb70-f5ed-4409-8d71-42e9225f7f32 could not be found. (HTTP 404) (Request-ID: req-d2c64551-9cfb-4e89-bcde-10b150cc85ff) Aug 30 01:01:09.942740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:01:09.942740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:09.942740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:01:09.943866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:09.943866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 01:01:09.943866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 01:01:09.943866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:01:09.943866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:01:09.943866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:01:09.943866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:01:09.943866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:01:09.943866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:01:09.943866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:01:09.943866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:01:09.943866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:01:09.943866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:01:09.943866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:01:09.943866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:01:09.943866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:01:09.943866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:01:09.943866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:01:09.943866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:01:09.945202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:01:09.945202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:01:09.945202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:01:09.945202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:01:09.945202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6fafeb70-f5ed-4409-8d71-42e9225f7f32 could not be found. Aug 30 01:01:09.945202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:01:09.945202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:09.945202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:01:09.945202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:09.945202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:01:09.945202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:01:09.945202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:01:09.945202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:01:09.945202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:01:09.945202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:01:09.945202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:01:09.945202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:01:09.945202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 01:01:09.945202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:01:09.946282 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6fafeb70-f5ed-4409-8d71-42e9225f7f32 could not be found. Aug 30 01:01:09.946282 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:01:09.946282 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:09.946282 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:01:09.946282 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:09.946282 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:01:09.946282 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:01:09.946282 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:01:09.946282 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:01:09.946282 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6fafeb70-f5ed-4409-8d71-42e9225f7f32 could not be found. Aug 30 01:01:09.946282 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:01:09.949263 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-b703d87e-4a68-4ff1-a725-6159dc812af2 tempest-VolumesGetTestJSON-1737204110 tempest-VolumesGetTestJSON-1737204110-project] Returning 404 to user: Volume 6fafeb70-f5ed-4409-8d71-42e9225f7f32 could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:01:09.950317 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-b703d87e-4a68-4ff1-a725-6159dc812af2 tempest-VolumesGetTestJSON-1737204110 tempest-VolumesGetTestJSON-1737204110-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6fafeb70-f5ed-4409-8d71-42e9225f7f32" status: 404 len: 109 microversion: 2.1 time: 0.097781 Aug 30 01:01:09.960541 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 10/21] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 30 01:01:09 2022] GET /compute/v2.1/os-volumes/6fafeb70-f5ed-4409-8d71-42e9225f7f32 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:01:10.560799 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f0e2164c-b842-43f8-8630-510645b1c286 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Calling method '.version_select at 0x7f0f53648160>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:10.614088 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-f0e2164c-b842-43f8-8630-510645b1c286 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] HTTP exception thrown: Snapshot 139d24a9-8fdd-43e5-ae52-c88e50e5fa92 could not be found. Aug 30 01:01:10.621465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f0e2164c-b842-43f8-8630-510645b1c286 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Request method failure captured: Aug 30 01:01:10.621465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: GET /compute/v2.1/os-snapshots/139d24a9-8fdd-43e5-ae52-c88e50e5fa92 HTTP/1.1 Aug 30 01:01:10.621465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:01:10.621465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:01:10.621465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:01:10.621465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:01:10.621465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:01:10.621465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:01:10.621465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:01:10.621465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:01:10.621465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWFMqzvVtqOVhZnkX09qFEACj0q8u0GvhMXROAaiIDpDylKLIwSJzC_x5In-aT1uPT4Ciug3_fsDoU7IBfl5MZciIZEiUnyupnqeNO4fqb572bGj2ykg58yDwpmQB6blE-nkBLDvsTIbg-XiKKxu7Fp6NmskrG68cZyh2GmjHqoQ7jY Aug 30 01:01:10.621465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:01:10.621465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:01:10.621465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:01:10.621465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:01:10.621465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:01:10.621465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:01:10.621465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: 276fb73b4bb04c41ac33daed2e04337a Aug 30 01:01:10.621465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-275130209 Aug 30 01:01:10.621465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:01:10.621465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:01:10.622568 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_276fb73b4bb04c41ac33daed2e04337a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/276fb73b4bb04c41ac33daed2e04337a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/276fb73b4bb04c41ac33daed2e04337a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/276fb73b4bb04c41ac33daed2e04337a"}]}] Aug 30 01:01:10.622568 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-VolumesSnapshotsTestJSON-275130209 Aug 30 01:01:10.622568 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: 276fb73b4bb04c41ac33daed2e04337a Aug 30 01:01:10.622568 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-275130209 Aug 30 01:01:10.622568 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-VolumesSnapshotsTestJSON-275130209-project Aug 30 01:01:10.622568 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:01:10.622568 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:01:10.622568 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: 46624f0e6b22475fb447ea07754ef529 Aug 30 01:01:10.622568 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-VolumesSnapshotsTestJSON-275130209-project Aug 30 01:01:10.622568 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: Aug 30 01:01:10.622568 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Snapshot 139d24a9-8fdd-43e5-ae52-c88e50e5fa92 could not be found. Aug 30 01:01:10.622568 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': '139d24a9-8fdd-43e5-ae52-c88e50e5fa92'} Aug 30 01:01:10.622568 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:01:10.623236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:10.623236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 01:01:10.623236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 01:01:10.623236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 01:01:10.623236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 01:01:10.623236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 01:01:10.623236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 01:01:10.623236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:01:10.623236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:01:10.623236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:01:10.623236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:01:10.623236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:01:10.623236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:01:10.623236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:01:10.623236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:01:10.623236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 139d24a9-8fdd-43e5-ae52-c88e50e5fa92 could not be found. (HTTP 404) (Request-ID: req-e4046886-043b-478f-a1c7-cb35d7cc1632) Aug 30 01:01:10.623236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:10.623236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:10.624062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:10.624062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:10.624062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 30 01:01:10.624062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 30 01:01:10.624062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:01:10.624062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:01:10.624062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 30 01:01:10.624062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 30 01:01:10.624062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:01:10.624062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:01:10.624062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 01:01:10.624062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 01:01:10.624062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 01:01:10.624062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 01:01:10.624062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 01:01:10.624062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 01:01:10.624062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:01:10.624062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:01:10.624062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:01:10.626206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:01:10.626206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:01:10.626206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:01:10.626206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:01:10.626206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:01:10.626206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 139d24a9-8fdd-43e5-ae52-c88e50e5fa92 could not be found. Aug 30 01:01:10.626206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:10.626206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:10.626206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:10.626206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:10.626206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:01:10.626206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:01:10.626206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:01:10.626206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:01:10.626206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:01:10.626206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:01:10.626206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:01:10.626206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:01:10.626206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 30 01:01:10.626206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:01:10.627685 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 139d24a9-8fdd-43e5-ae52-c88e50e5fa92 could not be found. Aug 30 01:01:10.627685 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:10.627685 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:10.627685 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:10.627685 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:10.627685 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:01:10.627685 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:01:10.627685 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:01:10.627685 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:01:10.627685 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 139d24a9-8fdd-43e5-ae52-c88e50e5fa92 could not be found. Aug 30 01:01:10.627685 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:10.634983 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f0e2164c-b842-43f8-8630-510645b1c286 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Returning 404 to user: Snapshot 139d24a9-8fdd-43e5-ae52-c88e50e5fa92 could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:01:10.636048 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-f0e2164c-b842-43f8-8630-510645b1c286 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/139d24a9-8fdd-43e5-ae52-c88e50e5fa92" status: 404 len: 111 microversion: 2.1 time: 0.080904 Aug 30 01:01:10.651003 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-bae15065-152f-4e97-b7df-b89bbcd9a2ff tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Calling method '.version_select at 0x7f0f535b3670>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:10.657125 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 12/22] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Aug 30 01:01:10 2022] GET /compute/v2.1/os-snapshots/139d24a9-8fdd-43e5-ae52-c88e50e5fa92 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:01:10.802226 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-bae15065-152f-4e97-b7df-b89bbcd9a2ff tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/4d4761dd-d918-47bc-9ad8-14162947c27b" status: 202 len: 0 microversion: 2.1 time: 0.160777 Aug 30 01:01:10.802944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 11/23] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 30 01:01:10 2022] DELETE /compute/v2.1/os-volumes/4d4761dd-d918-47bc-9ad8-14162947c27b => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:01:10.811632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-6534d24d-19e2-4e35-bcf8-6aab250666d9 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Calling method '.version_select at 0x7f0f535d1280>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:10.928108 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-6534d24d-19e2-4e35-bcf8-6aab250666d9 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/4d4761dd-d918-47bc-9ad8-14162947c27b" status: 200 len: 345 microversion: 2.1 time: 0.120734 Aug 30 01:01:10.930357 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 13/24] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 30 01:01:10 2022] GET /compute/v2.1/os-volumes/4d4761dd-d918-47bc-9ad8-14162947c27b => generated 345 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:01:11.946830 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-fdb6a939-3e44-4f26-bdcd-2426a9ea66b9 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Calling method '.version_select at 0x7f0f535b3ca0>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:12.067722 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-fdb6a939-3e44-4f26-bdcd-2426a9ea66b9 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/4d4761dd-d918-47bc-9ad8-14162947c27b" status: 200 len: 345 microversion: 2.1 time: 0.126558 Aug 30 01:01:12.068419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 12/25] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 30 01:01:11 2022] GET /compute/v2.1/os-volumes/4d4761dd-d918-47bc-9ad8-14162947c27b => generated 345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:13.083691 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-3dc731e2-2a06-4d48-94b9-6c3688ce2df0 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Calling method '.version_select at 0x7f0f535d1ee0>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:13.227898 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-3dc731e2-2a06-4d48-94b9-6c3688ce2df0 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/4d4761dd-d918-47bc-9ad8-14162947c27b" status: 200 len: 345 microversion: 2.1 time: 0.150083 Aug 30 01:01:13.228631 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 14/26] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 30 01:01:13 2022] GET /compute/v2.1/os-volumes/4d4761dd-d918-47bc-9ad8-14162947c27b => generated 345 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:13.664158 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e79da576-5d81-4fe7-ae51-ac00adab07bf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1096162832", "imageRef": "d6c817b5-c41c-4210-a963-172386e2e582", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:13.901820 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.network.neutron [None req-e79da576-5d81-4fe7-ae51-ac00adab07bf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] validate_networks() for [('5ee6ec53-bf26-4fab-b55f-62bd4221ec41', None, None, None, None, None)] {{(pid=120631) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:01:14.242627 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-a22344e7-bca7-468f-abcc-e2348357c458 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Calling method '.version_select at 0x7f0f535b8550>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:14.304304 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-a22344e7-bca7-468f-abcc-e2348357c458 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] HTTP exception thrown: Volume 4d4761dd-d918-47bc-9ad8-14162947c27b could not be found. Aug 30 01:01:14.307024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-a22344e7-bca7-468f-abcc-e2348357c458 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Request method failure captured: Aug 30 01:01:14.307024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: GET /compute/v2.1/os-volumes/4d4761dd-d918-47bc-9ad8-14162947c27b HTTP/1.1 Aug 30 01:01:14.307024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:01:14.307024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:01:14.307024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:01:14.307024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:01:14.307024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:01:14.307024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:01:14.307024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:01:14.307024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:01:14.307024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWFMqzvVtqOVhZnkX09qFEACj0q8u0GvhMXROAaiIDpDylKLIwSJzC_x5In-aT1uPT4Ciug3_fsDoU7IBfl5MZciIZEiUnyupnqeNO4fqb572bGj2ykg58yDwpmQB6blE-nkBLDvsTIbg-XiKKxu7Fp6NmskrG68cZyh2GmjHqoQ7jY Aug 30 01:01:14.307024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:01:14.307024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:01:14.307024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:01:14.307024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:01:14.307024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:01:14.307024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:01:14.307024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: 276fb73b4bb04c41ac33daed2e04337a Aug 30 01:01:14.307024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-275130209 Aug 30 01:01:14.307024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:01:14.307024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:01:14.308274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_276fb73b4bb04c41ac33daed2e04337a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/276fb73b4bb04c41ac33daed2e04337a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/276fb73b4bb04c41ac33daed2e04337a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/276fb73b4bb04c41ac33daed2e04337a"}]}] Aug 30 01:01:14.308274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-VolumesSnapshotsTestJSON-275130209 Aug 30 01:01:14.308274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: 276fb73b4bb04c41ac33daed2e04337a Aug 30 01:01:14.308274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-275130209 Aug 30 01:01:14.308274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-VolumesSnapshotsTestJSON-275130209-project Aug 30 01:01:14.308274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:01:14.308274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:01:14.308274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: 46624f0e6b22475fb447ea07754ef529 Aug 30 01:01:14.308274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-VolumesSnapshotsTestJSON-275130209-project Aug 30 01:01:14.308274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: Aug 30 01:01:14.308274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Volume 4d4761dd-d918-47bc-9ad8-14162947c27b could not be found. Aug 30 01:01:14.308274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': '4d4761dd-d918-47bc-9ad8-14162947c27b'} Aug 30 01:01:14.308274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:01:14.309010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:14.309010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:01:14.309010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:01:14.309010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:01:14.309010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:01:14.309010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:01:14.309010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:01:14.309010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:01:14.309010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:01:14.309010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:01:14.309010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:01:14.309010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:01:14.309010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:01:14.309010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:01:14.309010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:01:14.309010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4d4761dd-d918-47bc-9ad8-14162947c27b could not be found. (HTTP 404) (Request-ID: req-f9267cb9-e021-4bad-ab6b-789f0991ca46) Aug 30 01:01:14.309010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:14.309010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:14.309010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:14.321749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:14.321749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 01:01:14.321749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 01:01:14.321749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:01:14.321749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:01:14.321749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:01:14.321749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:01:14.321749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:01:14.321749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:01:14.321749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:01:14.321749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:01:14.321749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:01:14.321749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:01:14.321749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:01:14.321749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:01:14.321749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:01:14.321749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:01:14.321749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:01:14.321749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:01:14.323381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:01:14.323381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:01:14.323381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:01:14.323381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:01:14.323381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4d4761dd-d918-47bc-9ad8-14162947c27b could not be found. Aug 30 01:01:14.323381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:14.323381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:14.323381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:14.323381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:14.323381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:01:14.323381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:01:14.323381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:01:14.323381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:01:14.323381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:01:14.323381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:01:14.323381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:01:14.323381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:01:14.323381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 01:01:14.323381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:01:14.324401 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4d4761dd-d918-47bc-9ad8-14162947c27b could not be found. Aug 30 01:01:14.324401 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:14.324401 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:14.324401 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:14.324401 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:14.324401 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:01:14.324401 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:01:14.324401 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:01:14.324401 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:01:14.324401 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4d4761dd-d918-47bc-9ad8-14162947c27b could not be found. Aug 30 01:01:14.324401 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:14.324401 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-a22344e7-bca7-468f-abcc-e2348357c458 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Returning 404 to user: Volume 4d4761dd-d918-47bc-9ad8-14162947c27b could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:01:14.324401 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-a22344e7-bca7-468f-abcc-e2348357c458 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/4d4761dd-d918-47bc-9ad8-14162947c27b" status: 404 len: 109 microversion: 2.1 time: 0.069682 Aug 30 01:01:14.324401 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 15/27] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 30 01:01:14 2022] GET /compute/v2.1/os-volumes/4d4761dd-d918-47bc-9ad8-14162947c27b => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:01:14.328284 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-ac163fec-6315-484c-bfc3-1233f6856fd1 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Calling method '.version_select at 0x7f0f535d1430>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:14.403975 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-ac163fec-6315-484c-bfc3-1233f6856fd1 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] HTTP exception thrown: Volume 4d4761dd-d918-47bc-9ad8-14162947c27b could not be found. Aug 30 01:01:14.405943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-ac163fec-6315-484c-bfc3-1233f6856fd1 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Request method failure captured: Aug 30 01:01:14.405943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: DELETE /compute/v2.1/os-volumes/4d4761dd-d918-47bc-9ad8-14162947c27b HTTP/1.1 Aug 30 01:01:14.405943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:01:14.405943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:01:14.405943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:01:14.405943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:01:14.405943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:01:14.405943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:01:14.405943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:01:14.405943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:01:14.405943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWFMqzvVtqOVhZnkX09qFEACj0q8u0GvhMXROAaiIDpDylKLIwSJzC_x5In-aT1uPT4Ciug3_fsDoU7IBfl5MZciIZEiUnyupnqeNO4fqb572bGj2ykg58yDwpmQB6blE-nkBLDvsTIbg-XiKKxu7Fp6NmskrG68cZyh2GmjHqoQ7jY Aug 30 01:01:14.405943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:01:14.405943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:01:14.405943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:01:14.405943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:01:14.405943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:01:14.405943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:01:14.405943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: 276fb73b4bb04c41ac33daed2e04337a Aug 30 01:01:14.405943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-275130209 Aug 30 01:01:14.405943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:01:14.405943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:01:14.407234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_276fb73b4bb04c41ac33daed2e04337a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/276fb73b4bb04c41ac33daed2e04337a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/276fb73b4bb04c41ac33daed2e04337a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/276fb73b4bb04c41ac33daed2e04337a"}]}] Aug 30 01:01:14.407234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-VolumesSnapshotsTestJSON-275130209 Aug 30 01:01:14.407234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: 276fb73b4bb04c41ac33daed2e04337a Aug 30 01:01:14.407234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-275130209 Aug 30 01:01:14.407234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-VolumesSnapshotsTestJSON-275130209-project Aug 30 01:01:14.407234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:01:14.407234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:01:14.407234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: 46624f0e6b22475fb447ea07754ef529 Aug 30 01:01:14.407234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-VolumesSnapshotsTestJSON-275130209-project Aug 30 01:01:14.407234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: Aug 30 01:01:14.407234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Volume 4d4761dd-d918-47bc-9ad8-14162947c27b could not be found. Aug 30 01:01:14.407234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': '4d4761dd-d918-47bc-9ad8-14162947c27b'} Aug 30 01:01:14.407234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:01:14.408632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:14.408632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:01:14.408632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:01:14.408632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 01:01:14.408632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 01:01:14.408632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 01:01:14.408632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 01:01:14.408632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 01:01:14.408632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 01:01:14.408632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 01:01:14.408632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 01:01:14.408632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:01:14.408632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:01:14.408632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:01:14.408632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:01:14.408632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4d4761dd-d918-47bc-9ad8-14162947c27b could not be found. (HTTP 404) (Request-ID: req-b63d6a82-513d-46d2-a2cf-e13389dfb485) Aug 30 01:01:14.408632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:14.408632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:14.408632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:14.409927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:14.409927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 01:01:14.409927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 01:01:14.409927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:01:14.409927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:01:14.409927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:01:14.409927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:01:14.409927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:01:14.409927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:01:14.409927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:01:14.409927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:01:14.409927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 01:01:14.409927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 01:01:14.409927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 01:01:14.409927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 01:01:14.409927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 01:01:14.409927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 01:01:14.409927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 01:01:14.409927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 01:01:14.410941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:01:14.410941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:01:14.410941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:01:14.410941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:01:14.410941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4d4761dd-d918-47bc-9ad8-14162947c27b could not be found. Aug 30 01:01:14.410941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:14.410941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:14.410941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:14.410941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:14.410941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:01:14.410941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:01:14.410941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:01:14.410941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:01:14.410941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:01:14.410941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:01:14.410941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:01:14.410941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:01:14.410941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 01:01:14.410941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:01:14.412483 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4d4761dd-d918-47bc-9ad8-14162947c27b could not be found. Aug 30 01:01:14.412483 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:14.412483 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:14.412483 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:14.412483 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:14.412483 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:01:14.412483 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:01:14.412483 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:01:14.412483 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:01:14.412483 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4d4761dd-d918-47bc-9ad8-14162947c27b could not be found. Aug 30 01:01:14.412483 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:14.412483 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-ac163fec-6315-484c-bfc3-1233f6856fd1 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Returning 404 to user: Volume 4d4761dd-d918-47bc-9ad8-14162947c27b could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:01:14.412483 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-ac163fec-6315-484c-bfc3-1233f6856fd1 tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/4d4761dd-d918-47bc-9ad8-14162947c27b" status: 404 len: 109 microversion: 2.1 time: 0.083052 Aug 30 01:01:14.412483 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 16/28] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 30 01:01:14 2022] DELETE /compute/v2.1/os-volumes/4d4761dd-d918-47bc-9ad8-14162947c27b => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:01:14.416849 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f0e2c223-7fd5-4ef8-b9f6-fb65135ba14a tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Calling method '.version_select at 0x7f0f535d1af0>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:14.510511 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-f0e2c223-7fd5-4ef8-b9f6-fb65135ba14a tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] HTTP exception thrown: Volume 4d4761dd-d918-47bc-9ad8-14162947c27b could not be found. Aug 30 01:01:14.512774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f0e2c223-7fd5-4ef8-b9f6-fb65135ba14a tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Request method failure captured: Aug 30 01:01:14.512774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: GET /compute/v2.1/os-volumes/4d4761dd-d918-47bc-9ad8-14162947c27b HTTP/1.1 Aug 30 01:01:14.512774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:01:14.512774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:01:14.512774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:01:14.512774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:01:14.512774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:01:14.512774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:01:14.512774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:01:14.512774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:01:14.512774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWFMqzvVtqOVhZnkX09qFEACj0q8u0GvhMXROAaiIDpDylKLIwSJzC_x5In-aT1uPT4Ciug3_fsDoU7IBfl5MZciIZEiUnyupnqeNO4fqb572bGj2ykg58yDwpmQB6blE-nkBLDvsTIbg-XiKKxu7Fp6NmskrG68cZyh2GmjHqoQ7jY Aug 30 01:01:14.512774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:01:14.512774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:01:14.512774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:01:14.512774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:01:14.512774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:01:14.512774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:01:14.512774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: 276fb73b4bb04c41ac33daed2e04337a Aug 30 01:01:14.512774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-275130209 Aug 30 01:01:14.512774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:01:14.512774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:01:14.513973 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_276fb73b4bb04c41ac33daed2e04337a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/276fb73b4bb04c41ac33daed2e04337a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/276fb73b4bb04c41ac33daed2e04337a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/276fb73b4bb04c41ac33daed2e04337a"}]}] Aug 30 01:01:14.513973 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-VolumesSnapshotsTestJSON-275130209 Aug 30 01:01:14.513973 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: 276fb73b4bb04c41ac33daed2e04337a Aug 30 01:01:14.513973 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-275130209 Aug 30 01:01:14.513973 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-VolumesSnapshotsTestJSON-275130209-project Aug 30 01:01:14.513973 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:01:14.513973 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:01:14.513973 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: 46624f0e6b22475fb447ea07754ef529 Aug 30 01:01:14.513973 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-VolumesSnapshotsTestJSON-275130209-project Aug 30 01:01:14.513973 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: Aug 30 01:01:14.513973 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Volume 4d4761dd-d918-47bc-9ad8-14162947c27b could not be found. Aug 30 01:01:14.513973 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': '4d4761dd-d918-47bc-9ad8-14162947c27b'} Aug 30 01:01:14.513973 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:01:14.514673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:14.514673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:01:14.514673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:01:14.514673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:01:14.514673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:01:14.514673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:01:14.514673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:01:14.514673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:01:14.514673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:01:14.514673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:01:14.514673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:01:14.514673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:01:14.514673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:01:14.514673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:01:14.514673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:01:14.514673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4d4761dd-d918-47bc-9ad8-14162947c27b could not be found. (HTTP 404) (Request-ID: req-cd937729-1286-4b60-9f08-79019276b83c) Aug 30 01:01:14.514673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:14.514673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:14.514673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:14.515638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:14.515638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 01:01:14.515638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 01:01:14.515638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:01:14.515638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:01:14.515638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:01:14.515638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:01:14.515638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:01:14.515638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:01:14.515638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:01:14.515638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:01:14.515638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:01:14.515638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:01:14.515638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:01:14.515638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:01:14.515638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:01:14.515638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:01:14.515638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:01:14.515638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:01:14.519389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:01:14.519389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:01:14.519389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:01:14.519389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:01:14.519389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4d4761dd-d918-47bc-9ad8-14162947c27b could not be found. Aug 30 01:01:14.519389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:14.519389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:14.519389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:14.519389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:14.519389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:01:14.519389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:01:14.519389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:01:14.519389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:01:14.519389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:01:14.519389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:01:14.519389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:01:14.519389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:01:14.519389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 01:01:14.519389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:01:14.520367 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4d4761dd-d918-47bc-9ad8-14162947c27b could not be found. Aug 30 01:01:14.520367 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:14.520367 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:14.520367 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:14.520367 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:14.520367 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:01:14.520367 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:01:14.520367 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:01:14.520367 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:01:14.520367 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4d4761dd-d918-47bc-9ad8-14162947c27b could not be found. Aug 30 01:01:14.520367 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:01:14.521719 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f0e2c223-7fd5-4ef8-b9f6-fb65135ba14a tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] Returning 404 to user: Volume 4d4761dd-d918-47bc-9ad8-14162947c27b could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:01:14.523292 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-f0e2c223-7fd5-4ef8-b9f6-fb65135ba14a tempest-VolumesSnapshotsTestJSON-275130209 tempest-VolumesSnapshotsTestJSON-275130209-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/4d4761dd-d918-47bc-9ad8-14162947c27b" status: 404 len: 109 microversion: 2.1 time: 0.110293 Aug 30 01:01:14.528901 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 17/29] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 30 01:01:14 2022] GET /compute/v2.1/os-volumes/4d4761dd-d918-47bc-9ad8-14162947c27b => generated 109 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:01:16.723969 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-e79da576-5d81-4fe7-ae51-ac00adab07bf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Flavor limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:01:16.725613 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-e79da576-5d81-4fe7-ae51-ac00adab07bf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Image limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:01:16.726776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-e79da576-5d81-4fe7-ae51-ac00adab07bf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Flavor pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:01:16.727613 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-e79da576-5d81-4fe7-ae51-ac00adab07bf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Image pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:01:16.728366 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-e79da576-5d81-4fe7-ae51-ac00adab07bf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:01:16.760811 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e79da576-5d81-4fe7-ae51-ac00adab07bf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:16.766031 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e79da576-5d81-4fe7-ae51-ac00adab07bf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:16.766756 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e79da576-5d81-4fe7-ae51-ac00adab07bf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:16.770387 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e79da576-5d81-4fe7-ae51-ac00adab07bf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:16.770887 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e79da576-5d81-4fe7-ae51-ac00adab07bf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:16.771709 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e79da576-5d81-4fe7-ae51-ac00adab07bf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:16.838226 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-e79da576-5d81-4fe7-ae51-ac00adab07bf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Getting quotas for project ceebbaa5dd9d4110a6393190c5b466f0. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:01:16.850621 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-e79da576-5d81-4fe7-ae51-ac00adab07bf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Getting quotas for user 5c95c8ce27fd43c6a6fe10443b6bde13 and project ceebbaa5dd9d4110a6393190c5b466f0. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:01:16.914538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e79da576-5d81-4fe7-ae51-ac00adab07bf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Going to run 1 instances... {{(pid=120631) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:01:16.947158 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e79da576-5d81-4fe7-ae51-ac00adab07bf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6c817b5-c41c-4210-a963-172386e2e582',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120631) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:01:17.191044 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e79da576-5d81-4fe7-ae51-ac00adab07bf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.667132 Aug 30 01:01:17.196682 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 13/30] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 30 01:01:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 3674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:01:17.209674 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-488b9c56-3d08-474f-9677-2de94fe41409 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:17.211423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-488b9c56-3d08-474f-9677-2de94fe41409 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:17.613051 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-488b9c56-3d08-474f-9677-2de94fe41409 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:17.656095 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-488b9c56-3d08-474f-9677-2de94fe41409 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1222 microversion: 2.1 time: 0.452453 Aug 30 01:01:17.663553 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 18/31] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:17 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1222 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:18.098334 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-b4008f7c-d85c-4772-9ddf-86d0953f2cf7 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Action: 'create', calling method: .version_select at 0x7f0f534b1940>, body: {"keypair": {"name": "tempest-keypair-751847141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4UNae4YryH+ViA7glXElNREMc5yDhnOd6bQtQJFVweVHzQMBUBlNLPEn9Aeb9+5Uc5r3LclOK3LKlxXyVRdEfgI8QckQZgrrJWx4GxAdM9GsSQrCrGcKUO/EdPLnRIag=="}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:18.185897 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-b4008f7c-d85c-4772-9ddf-86d0953f2cf7 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Getting quotas for project f40b3e29a18b48cba6800c9f3a0dfee9. Resources: {'key_pairs'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:01:18.201274 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-b4008f7c-d85c-4772-9ddf-86d0953f2cf7 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Getting quotas for user c6fe0e0033de447da70be9bc0228eba2 and project f40b3e29a18b48cba6800c9f3a0dfee9. Resources: {'key_pairs'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:01:18.308565 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-b4008f7c-d85c-4772-9ddf-86d0953f2cf7 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.896706 Aug 30 01:01:18.310781 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 14/32] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 30 01:01:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:18.408544 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-0251b6e6-99ba-49c3-88ba-59cd562bb13c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1722164656", "imageRef": "d6c817b5-c41c-4210-a963-172386e2e582", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:18.738224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.network.neutron [None req-0251b6e6-99ba-49c3-88ba-59cd562bb13c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] validate_networks() for [('5ee6ec53-bf26-4fab-b55f-62bd4221ec41', None, None, None, None, None)] {{(pid=120630) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:01:19.883339 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-85eaaaad-cfb4-4e35-881c-8ba84759874d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-20908401", "imageRef": "d6c817b5-c41c-4210-a963-172386e2e582", "flavorRef": "452", "networks": [{"uuid": "f64316af-4378-4002-9747-c897421bae08"}]}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:20.029391 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.network.neutron [None req-85eaaaad-cfb4-4e35-881c-8ba84759874d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] validate_networks() for [('f64316af-4378-4002-9747-c897421bae08', None, None, None, None, None)] {{(pid=120631) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:01:21.801311 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-85eaaaad-cfb4-4e35-881c-8ba84759874d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Flavor limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:01:21.801811 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-85eaaaad-cfb4-4e35-881c-8ba84759874d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Image limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:01:21.802218 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-85eaaaad-cfb4-4e35-881c-8ba84759874d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Flavor pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:01:21.802850 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-85eaaaad-cfb4-4e35-881c-8ba84759874d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Image pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:01:21.803275 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-85eaaaad-cfb4-4e35-881c-8ba84759874d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:01:21.827243 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-85eaaaad-cfb4-4e35-881c-8ba84759874d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:21.835689 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-85eaaaad-cfb4-4e35-881c-8ba84759874d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:21.836676 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-85eaaaad-cfb4-4e35-881c-8ba84759874d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:21.839455 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-0251b6e6-99ba-49c3-88ba-59cd562bb13c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Flavor limits 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:01:21.839974 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-0251b6e6-99ba-49c3-88ba-59cd562bb13c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Image limits 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:01:21.840327 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-0251b6e6-99ba-49c3-88ba-59cd562bb13c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Flavor pref 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:01:21.840738 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-0251b6e6-99ba-49c3-88ba-59cd562bb13c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Image pref 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:01:21.841050 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-85eaaaad-cfb4-4e35-881c-8ba84759874d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:21.841226 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-0251b6e6-99ba-49c3-88ba-59cd562bb13c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:01:21.841897 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-85eaaaad-cfb4-4e35-881c-8ba84759874d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:21.843621 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-85eaaaad-cfb4-4e35-881c-8ba84759874d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:21.874632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0251b6e6-99ba-49c3-88ba-59cd562bb13c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:21.875243 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0251b6e6-99ba-49c3-88ba-59cd562bb13c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:21.875857 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0251b6e6-99ba-49c3-88ba-59cd562bb13c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:21.878367 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0251b6e6-99ba-49c3-88ba-59cd562bb13c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:21.883049 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0251b6e6-99ba-49c3-88ba-59cd562bb13c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:21.891444 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0251b6e6-99ba-49c3-88ba-59cd562bb13c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:21.894790 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-85eaaaad-cfb4-4e35-881c-8ba84759874d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Getting quotas for project 0c0f91770bb14bb6920fc277936c189e. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:01:21.909478 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-85eaaaad-cfb4-4e35-881c-8ba84759874d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Getting quotas for user e4cc89946c2e45a0a75eef16cb042758 and project 0c0f91770bb14bb6920fc277936c189e. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:01:21.952432 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-85eaaaad-cfb4-4e35-881c-8ba84759874d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Going to run 1 instances... {{(pid=120631) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:01:21.965824 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-0251b6e6-99ba-49c3-88ba-59cd562bb13c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Getting quotas for project ceebbaa5dd9d4110a6393190c5b466f0. Resources: {'ram', 'instances', 'cores'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:01:21.975482 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-85eaaaad-cfb4-4e35-881c-8ba84759874d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6c817b5-c41c-4210-a963-172386e2e582',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120631) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:01:21.988216 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-0251b6e6-99ba-49c3-88ba-59cd562bb13c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Getting quotas for user 5c95c8ce27fd43c6a6fe10443b6bde13 and project ceebbaa5dd9d4110a6393190c5b466f0. Resources: {'ram', 'instances', 'cores'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:01:22.004003 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-0251b6e6-99ba-49c3-88ba-59cd562bb13c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Going to run 1 instances... {{(pid=120630) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:01:22.008513 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-0251b6e6-99ba-49c3-88ba-59cd562bb13c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6c817b5-c41c-4210-a963-172386e2e582',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:01:22.134489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-85eaaaad-cfb4-4e35-881c-8ba84759874d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.649678 Aug 30 01:01:22.135304 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 15/33] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 30 01:01:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:01:22.172437 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-0251b6e6-99ba-49c3-88ba-59cd562bb13c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.770368 Aug 30 01:01:22.175665 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 19/34] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 30 01:01:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 3775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 01:01:22.191395 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-fb61e6fc-7066-4e91-a9bb-68b6d761f4fc tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:22.192033 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-fb61e6fc-7066-4e91-a9bb-68b6d761f4fc tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:22.518446 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-fb61e6fc-7066-4e91-a9bb-68b6d761f4fc tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:22.528644 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-fb61e6fc-7066-4e91-a9bb-68b6d761f4fc tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1213 microversion: 2.1 time: 0.345812 Aug 30 01:01:22.529270 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 20/35] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:22 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1213 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:22.541829 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f4609147-17ad-4d2d-a7c9-42630c6b40f2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:22.542863 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-f4609147-17ad-4d2d-a7c9-42630c6b40f2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:22.699861 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-14f188cd-c0de-4eb9-9405-26747524988a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Action: 'create', calling method: .version_select at 0x7f0f52c53f70>, body: {"keypair": {"name": "tempest-keypair-192310298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2cslpfcSmXYk9SFA+lrqh3eFjJL2kB0iprcC/vMUrgQfAq+vxxkE77BxOsnWsC6VkosaMmuv7vaY0y3LjW99jUjylQ3Smm9z5/70wHWJ4leCYulXX68TWPJz+VxaWpGg=="}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:22.713623 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-f4609147-17ad-4d2d-a7c9-42630c6b40f2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:22.732482 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-f4609147-17ad-4d2d-a7c9-42630c6b40f2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1222 microversion: 2.1 time: 0.195358 Aug 30 01:01:22.752980 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 21/36] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:22 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1222 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:22.770664 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-14f188cd-c0de-4eb9-9405-26747524988a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Getting quotas for project 0596692dbfb149139a1e72159c6f93db. Resources: {'key_pairs'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:01:22.797925 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-14f188cd-c0de-4eb9-9405-26747524988a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Getting quotas for user cc7cf306aadb45d1b65252b53c86b612 and project 0596692dbfb149139a1e72159c6f93db. Resources: {'key_pairs'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:01:22.886027 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-14f188cd-c0de-4eb9-9405-26747524988a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.749475 Aug 30 01:01:22.887093 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 16/37] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 30 01:01:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:23.551945 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-862e6bde-b87b-4bf3-a032-f960d42b4b85 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:23.552567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-862e6bde-b87b-4bf3-a032-f960d42b4b85 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:23.774742 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-02870061-efd0-4f13-8a50-78c3f672e02f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:23.775431 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-02870061-efd0-4f13-8a50-78c3f672e02f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:23.838114 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-02870061-efd0-4f13-8a50-78c3f672e02f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:23.839019 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-02870061-efd0-4f13-8a50-78c3f672e02f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:23.841106 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-02870061-efd0-4f13-8a50-78c3f672e02f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:23.843123 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-02870061-efd0-4f13-8a50-78c3f672e02f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:23.844777 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-02870061-efd0-4f13-8a50-78c3f672e02f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:23.847901 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-02870061-efd0-4f13-8a50-78c3f672e02f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:23.914049 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-862e6bde-b87b-4bf3-a032-f960d42b4b85 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:23.937757 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-862e6bde-b87b-4bf3-a032-f960d42b4b85 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1213 microversion: 2.1 time: 0.382902 Aug 30 01:01:23.941048 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 22/38] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:23 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1213 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:24.226519 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-377a3cc7-aff9-4320-b5d2-b7284015684b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-168829459", "imageRef": "d6c817b5-c41c-4210-a963-172386e2e582", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b956883-0f29-4de3-9788-00541616d922"}], "security_groups": [{"name": "tempest-securitygroup--579645224"}], "key_name": "tempest-keypair-751847141", "user_data": "}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:24.652667 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-02870061-efd0-4f13-8a50-78c3f672e02f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:24.690375 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-02870061-efd0-4f13-8a50-78c3f672e02f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1218 microversion: 2.1 time: 0.919482 Aug 30 01:01:24.693915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 17/39] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:23 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1218 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:24.951755 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.network.neutron [None req-377a3cc7-aff9-4320-b5d2-b7284015684b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] validate_networks() for [('0b956883-0f29-4de3-9788-00541616d922', None, None, None, None, None)] {{(pid=120630) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:01:24.966365 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-5d1db45c-0754-4989-8f39-af005a2dc0c2 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:24.966978 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-5d1db45c-0754-4989-8f39-af005a2dc0c2 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:24.984010 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5d1db45c-0754-4989-8f39-af005a2dc0c2 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:24.987466 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5d1db45c-0754-4989-8f39-af005a2dc0c2 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:24.988151 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5d1db45c-0754-4989-8f39-af005a2dc0c2 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:24.989061 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5d1db45c-0754-4989-8f39-af005a2dc0c2 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:24.991667 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5d1db45c-0754-4989-8f39-af005a2dc0c2 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:24.992903 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5d1db45c-0754-4989-8f39-af005a2dc0c2 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:25.294418 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-5d1db45c-0754-4989-8f39-af005a2dc0c2 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:25.326209 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-5d1db45c-0754-4989-8f39-af005a2dc0c2 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1209 microversion: 2.1 time: 0.361791 Aug 30 01:01:25.330528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 18/40] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:24 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1209 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:25.715113 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-8f107f9a-8280-498f-872c-e101cb13d395 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:25.716119 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-8f107f9a-8280-498f-872c-e101cb13d395 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:25.753235 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f107f9a-8280-498f-872c-e101cb13d395 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:25.754428 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f107f9a-8280-498f-872c-e101cb13d395 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:25.755046 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f107f9a-8280-498f-872c-e101cb13d395 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:25.764982 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f107f9a-8280-498f-872c-e101cb13d395 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:25.765502 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f107f9a-8280-498f-872c-e101cb13d395 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:25.765955 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f107f9a-8280-498f-872c-e101cb13d395 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:26.517463 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-8f107f9a-8280-498f-872c-e101cb13d395 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:26.528061 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-8f107f9a-8280-498f-872c-e101cb13d395 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1282 microversion: 2.1 time: 0.816540 Aug 30 01:01:26.555695 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 19/41] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:25 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1282 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:26.566198 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0873cf05-724c-4b5a-9a5c-3fd266724a32 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:26.567217 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-0873cf05-724c-4b5a-9a5c-3fd266724a32 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:26.581262 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0873cf05-724c-4b5a-9a5c-3fd266724a32 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:26.597608 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0873cf05-724c-4b5a-9a5c-3fd266724a32 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:26.598238 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0873cf05-724c-4b5a-9a5c-3fd266724a32 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:26.599164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0873cf05-724c-4b5a-9a5c-3fd266724a32 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:26.599788 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0873cf05-724c-4b5a-9a5c-3fd266724a32 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:26.600379 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0873cf05-724c-4b5a-9a5c-3fd266724a32 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:27.226059 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-0873cf05-724c-4b5a-9a5c-3fd266724a32 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:27.245419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0873cf05-724c-4b5a-9a5c-3fd266724a32 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1265 microversion: 2.1 time: 0.688438 Aug 30 01:01:27.246538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 20/42] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:26 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1265 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:27.552208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-48ad23a3-fbe2-4264-840c-55cffa358ed7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:27.553145 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-48ad23a3-fbe2-4264-840c-55cffa358ed7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:27.597952 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-48ad23a3-fbe2-4264-840c-55cffa358ed7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:27.598614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-48ad23a3-fbe2-4264-840c-55cffa358ed7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:27.599140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-48ad23a3-fbe2-4264-840c-55cffa358ed7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:27.600096 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-48ad23a3-fbe2-4264-840c-55cffa358ed7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:27.605780 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-48ad23a3-fbe2-4264-840c-55cffa358ed7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:27.607440 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-48ad23a3-fbe2-4264-840c-55cffa358ed7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:28.026180 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-377a3cc7-aff9-4320-b5d2-b7284015684b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Flavor limits 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:01:28.027181 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-377a3cc7-aff9-4320-b5d2-b7284015684b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Image limits 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:01:28.027821 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-377a3cc7-aff9-4320-b5d2-b7284015684b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Flavor pref 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:01:28.029052 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-377a3cc7-aff9-4320-b5d2-b7284015684b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Image pref 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:01:28.029668 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-377a3cc7-aff9-4320-b5d2-b7284015684b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:01:28.055659 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-377a3cc7-aff9-4320-b5d2-b7284015684b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:28.056410 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-377a3cc7-aff9-4320-b5d2-b7284015684b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:28.057017 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-377a3cc7-aff9-4320-b5d2-b7284015684b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:28.058118 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-377a3cc7-aff9-4320-b5d2-b7284015684b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:28.058737 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-377a3cc7-aff9-4320-b5d2-b7284015684b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:28.059378 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-377a3cc7-aff9-4320-b5d2-b7284015684b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:28.117678 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-377a3cc7-aff9-4320-b5d2-b7284015684b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Getting quotas for project f40b3e29a18b48cba6800c9f3a0dfee9. Resources: {'ram', 'instances', 'cores'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:01:28.135799 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-377a3cc7-aff9-4320-b5d2-b7284015684b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Getting quotas for user c6fe0e0033de447da70be9bc0228eba2 and project f40b3e29a18b48cba6800c9f3a0dfee9. Resources: {'ram', 'instances', 'cores'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:01:28.150066 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-48ad23a3-fbe2-4264-840c-55cffa358ed7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:28.165609 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-48ad23a3-fbe2-4264-840c-55cffa358ed7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1280 microversion: 2.1 time: 0.618746 Aug 30 01:01:28.174081 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 21/43] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:27 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1280 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:01:28.186151 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-377a3cc7-aff9-4320-b5d2-b7284015684b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Going to run 1 instances... {{(pid=120630) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:01:28.195695 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-377a3cc7-aff9-4320-b5d2-b7284015684b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6c817b5-c41c-4210-a963-172386e2e582',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:01:28.270007 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3b42c01b-a186-420f-92c6-fe8a45d45c63 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:28.270631 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-3b42c01b-a186-420f-92c6-fe8a45d45c63 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:28.288843 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3b42c01b-a186-420f-92c6-fe8a45d45c63 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:28.291964 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3b42c01b-a186-420f-92c6-fe8a45d45c63 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:28.295453 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3b42c01b-a186-420f-92c6-fe8a45d45c63 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:28.298545 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3b42c01b-a186-420f-92c6-fe8a45d45c63 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:28.301474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3b42c01b-a186-420f-92c6-fe8a45d45c63 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:28.305288 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3b42c01b-a186-420f-92c6-fe8a45d45c63 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:28.356187 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-377a3cc7-aff9-4320-b5d2-b7284015684b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.133803 Aug 30 01:01:28.364667 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 23/44] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 30 01:01:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 4143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 01:01:28.375685 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-b74a0155-5b8a-4512-8a24-7fa977bb6460 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:28.378187 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-b74a0155-5b8a-4512-8a24-7fa977bb6460 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:29.061467 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-b74a0155-5b8a-4512-8a24-7fa977bb6460 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:29.067775 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3b42c01b-a186-420f-92c6-fe8a45d45c63 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:29.076460 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3b42c01b-a186-420f-92c6-fe8a45d45c63 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1271 microversion: 2.1 time: 0.811462 Aug 30 01:01:29.085486 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 22/45] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:28 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1271 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:29.092312 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-b74a0155-5b8a-4512-8a24-7fa977bb6460 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1236 microversion: 2.1 time: 0.726188 Aug 30 01:01:29.114520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 24/46] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:28 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1236 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:29.194776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e82b646e-67b6-4e3d-b688-a53979ba6a10 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:29.195535 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e82b646e-67b6-4e3d-b688-a53979ba6a10 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:29.205096 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e82b646e-67b6-4e3d-b688-a53979ba6a10 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:29.212816 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e82b646e-67b6-4e3d-b688-a53979ba6a10 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:29.217763 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e82b646e-67b6-4e3d-b688-a53979ba6a10 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:29.218801 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e82b646e-67b6-4e3d-b688-a53979ba6a10 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:29.219517 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e82b646e-67b6-4e3d-b688-a53979ba6a10 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:29.220818 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e82b646e-67b6-4e3d-b688-a53979ba6a10 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:29.461522 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e82b646e-67b6-4e3d-b688-a53979ba6a10 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:29.470403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e82b646e-67b6-4e3d-b688-a53979ba6a10 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1280 microversion: 2.1 time: 0.278842 Aug 30 01:01:29.480500 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 23/47] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:29 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1280 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:01:30.120445 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-b87a47c7-b571-40f9-87d8-96599ad561ce tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:30.121977 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-a5e0795a-310e-47c2-ad7c-f17a32f326db tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:30.123388 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-b87a47c7-b571-40f9-87d8-96599ad561ce tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:30.124174 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-a5e0795a-310e-47c2-ad7c-f17a32f326db tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:30.136799 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a5e0795a-310e-47c2-ad7c-f17a32f326db tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:30.148940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b87a47c7-b571-40f9-87d8-96599ad561ce tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:30.150118 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a5e0795a-310e-47c2-ad7c-f17a32f326db tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:30.155680 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b87a47c7-b571-40f9-87d8-96599ad561ce tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:30.156524 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a5e0795a-310e-47c2-ad7c-f17a32f326db tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:30.162854 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a5e0795a-310e-47c2-ad7c-f17a32f326db tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:30.164284 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b87a47c7-b571-40f9-87d8-96599ad561ce tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:30.166664 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b87a47c7-b571-40f9-87d8-96599ad561ce tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:30.167419 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a5e0795a-310e-47c2-ad7c-f17a32f326db tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:30.168968 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b87a47c7-b571-40f9-87d8-96599ad561ce tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:30.169264 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a5e0795a-310e-47c2-ad7c-f17a32f326db tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:30.172589 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b87a47c7-b571-40f9-87d8-96599ad561ce tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:31.088306 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-a5e0795a-310e-47c2-ad7c-f17a32f326db tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:31.122109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-b87a47c7-b571-40f9-87d8-96599ad561ce tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:31.134912 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-a5e0795a-310e-47c2-ad7c-f17a32f326db tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1313 microversion: 2.1 time: 1.028612 Aug 30 01:01:31.138654 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-b87a47c7-b571-40f9-87d8-96599ad561ce tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1288 microversion: 2.1 time: 1.022085 Aug 30 01:01:31.149810 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 25/48] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:30 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1313 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:31.154346 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 24/49] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:30 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1288 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:01:31.162003 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-1aec3a8e-9e86-4e99-bbe1-74194b877e95 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:31.174867 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-1aec3a8e-9e86-4e99-bbe1-74194b877e95 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:31.231558 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1aec3a8e-9e86-4e99-bbe1-74194b877e95 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:31.232313 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1aec3a8e-9e86-4e99-bbe1-74194b877e95 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:31.233351 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1aec3a8e-9e86-4e99-bbe1-74194b877e95 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:31.234304 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1aec3a8e-9e86-4e99-bbe1-74194b877e95 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:31.234971 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1aec3a8e-9e86-4e99-bbe1-74194b877e95 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:31.236312 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1aec3a8e-9e86-4e99-bbe1-74194b877e95 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:32.134150 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-1aec3a8e-9e86-4e99-bbe1-74194b877e95 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:32.144500 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-1aec3a8e-9e86-4e99-bbe1-74194b877e95 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1280 microversion: 2.1 time: 0.992444 Aug 30 01:01:32.145251 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 26/50] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:31 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1280 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:32.170581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-53d41ec2-c5af-4935-a90b-c260cf34e8b6 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:32.172169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-53d41ec2-c5af-4935-a90b-c260cf34e8b6 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:32.175220 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=4 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:32.181485 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-019e6d3f-af8e-4f37-befc-f415d676724b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:32.182272 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-019e6d3f-af8e-4f37-befc-f415d676724b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:32.198762 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-019e6d3f-af8e-4f37-befc-f415d676724b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:32.200861 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-019e6d3f-af8e-4f37-befc-f415d676724b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:32.201560 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-53d41ec2-c5af-4935-a90b-c260cf34e8b6 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:32.202237 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-019e6d3f-af8e-4f37-befc-f415d676724b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:32.204379 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-019e6d3f-af8e-4f37-befc-f415d676724b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:32.205364 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-53d41ec2-c5af-4935-a90b-c260cf34e8b6 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:32.206112 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-019e6d3f-af8e-4f37-befc-f415d676724b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:32.206716 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-53d41ec2-c5af-4935-a90b-c260cf34e8b6 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:32.208182 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-019e6d3f-af8e-4f37-befc-f415d676724b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:32.208929 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-53d41ec2-c5af-4935-a90b-c260cf34e8b6 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:32.212599 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-53d41ec2-c5af-4935-a90b-c260cf34e8b6 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:32.213133 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-53d41ec2-c5af-4935-a90b-c260cf34e8b6 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:32.821441 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=20 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:32.931871 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-019e6d3f-af8e-4f37-befc-f415d676724b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:32.949534 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-019e6d3f-af8e-4f37-befc-f415d676724b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1294 microversion: 2.1 time: 0.771522 Aug 30 01:01:32.950774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 27/51] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:32 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1294 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:33.074787 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-6005f2eb-390f-4342-a35b-4dc4445a43c8 req-5592af21-c9ac-40c8-b310-381baa54567d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12338ddc-349d-4f0b-b6d8-4bb83f19e320", "tag": "d60f2857-a480-4c65-88cc-9e8dd6a7cbf4"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:33.112998 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-6005f2eb-390f-4342-a35b-4dc4445a43c8 req-5592af21-c9ac-40c8-b310-381baa54567d service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:33.113945 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-6005f2eb-390f-4342-a35b-4dc4445a43c8 req-5592af21-c9ac-40c8-b310-381baa54567d service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:33.114350 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-6005f2eb-390f-4342-a35b-4dc4445a43c8 req-5592af21-c9ac-40c8-b310-381baa54567d service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:33.182663 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-6005f2eb-390f-4342-a35b-4dc4445a43c8 req-5592af21-c9ac-40c8-b310-381baa54567d service nova] Creating event network-changed:d60f2857-a480-4c65-88cc-9e8dd6a7cbf4 for instance 12338ddc-349d-4f0b-b6d8-4bb83f19e320 on hv-cinder-81514 Aug 30 01:01:33.183319 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-6005f2eb-390f-4342-a35b-4dc4445a43c8 req-5592af21-c9ac-40c8-b310-381baa54567d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120630) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 01:01:33.183567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-6005f2eb-390f-4342-a35b-4dc4445a43c8 req-5592af21-c9ac-40c8-b310-381baa54567d service nova] Acquired lock "compute-rpcapi-router" {{(pid=120630) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 01:01:33.190435 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8b97964e-9421-4c34-a4ba-fd856cbe079a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:33.193700 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8b97964e-9421-4c34-a4ba-fd856cbe079a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:33.194343 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8b97964e-9421-4c34-a4ba-fd856cbe079a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:33.195275 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8b97964e-9421-4c34-a4ba-fd856cbe079a None None] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:33.205740 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8b97964e-9421-4c34-a4ba-fd856cbe079a None None] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:33.206500 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8b97964e-9421-4c34-a4ba-fd856cbe079a None None] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:33.228948 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.compute.rpcapi [None req-8b97964e-9421-4c34-a4ba-fd856cbe079a None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 01:01:33.230143 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8b97964e-9421-4c34-a4ba-fd856cbe079a None None] Releasing lock "compute-rpcapi-router" {{(pid=120630) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 01:01:33.270272 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8b97964e-9421-4c34-a4ba-fd856cbe079a None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.317630 Aug 30 01:01:33.271784 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 28/52] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:33.277692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-fa7815dd-c7a1-4741-acc7-99219b354ec3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:33.290157 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-fa7815dd-c7a1-4741-acc7-99219b354ec3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:33.315872 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fa7815dd-c7a1-4741-acc7-99219b354ec3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:33.316767 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fa7815dd-c7a1-4741-acc7-99219b354ec3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:33.317472 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fa7815dd-c7a1-4741-acc7-99219b354ec3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:33.318443 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fa7815dd-c7a1-4741-acc7-99219b354ec3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:33.319887 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fa7815dd-c7a1-4741-acc7-99219b354ec3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:33.333998 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fa7815dd-c7a1-4741-acc7-99219b354ec3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:33.854283 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-fa7815dd-c7a1-4741-acc7-99219b354ec3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:33.863322 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-fa7815dd-c7a1-4741-acc7-99219b354ec3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1280 microversion: 2.1 time: 0.590167 Aug 30 01:01:33.863905 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 29/53] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:33 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1280 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:33.880615 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-53d41ec2-c5af-4935-a90b-c260cf34e8b6 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:33.911343 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-53d41ec2-c5af-4935-a90b-c260cf34e8b6 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1313 microversion: 2.1 time: 1.745237 Aug 30 01:01:33.925316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 25/54] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:32 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1313 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:33.976872 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-d8e9372d-4a34-4c4f-8dff-09f6b2eac885 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:33.977599 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-d8e9372d-4a34-4c4f-8dff-09f6b2eac885 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:33.990992 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d8e9372d-4a34-4c4f-8dff-09f6b2eac885 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:33.991502 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d8e9372d-4a34-4c4f-8dff-09f6b2eac885 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:33.992826 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d8e9372d-4a34-4c4f-8dff-09f6b2eac885 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:33.993591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d8e9372d-4a34-4c4f-8dff-09f6b2eac885 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:33.994048 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d8e9372d-4a34-4c4f-8dff-09f6b2eac885 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:33.994477 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d8e9372d-4a34-4c4f-8dff-09f6b2eac885 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:34.323287 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-d8e9372d-4a34-4c4f-8dff-09f6b2eac885 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:34.333987 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-d8e9372d-4a34-4c4f-8dff-09f6b2eac885 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1294 microversion: 2.1 time: 0.360412 Aug 30 01:01:34.335501 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 30/55] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:33 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1294 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:34.886373 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-c1367363-6185-4aad-9a03-2c9ff95d5202 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-602963314", "imageRef": "d6c817b5-c41c-4210-a963-172386e2e582", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dffca817-1d31-4c9c-99a3-2d8483c143b4"}], "security_groups": [{"name": "tempest-securitygroup--1554597733"}], "key_name": "tempest-keypair-192310298", "user_data": "}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:34.889489 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-5c7eaf69-5a69-4251-9ba3-80540e0e98b2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:34.890322 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-5c7eaf69-5a69-4251-9ba3-80540e0e98b2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:34.904578 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5c7eaf69-5a69-4251-9ba3-80540e0e98b2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:34.905350 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5c7eaf69-5a69-4251-9ba3-80540e0e98b2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:34.905963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5c7eaf69-5a69-4251-9ba3-80540e0e98b2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:34.907473 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5c7eaf69-5a69-4251-9ba3-80540e0e98b2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:34.908071 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5c7eaf69-5a69-4251-9ba3-80540e0e98b2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:34.908647 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5c7eaf69-5a69-4251-9ba3-80540e0e98b2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:35.244327 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.network.neutron [None req-c1367363-6185-4aad-9a03-2c9ff95d5202 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] validate_networks() for [('dffca817-1d31-4c9c-99a3-2d8483c143b4', None, None, None, None, None)] {{(pid=120631) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:01:35.545408 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-5c7eaf69-5a69-4251-9ba3-80540e0e98b2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:35.555840 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-5c7eaf69-5a69-4251-9ba3-80540e0e98b2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1322 microversion: 2.1 time: 0.670224 Aug 30 01:01:35.561129 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 31/56] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:34 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1322 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:01:35.561798 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-99fe5547-ca2f-47bf-89ed-689d7f00e2f1 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:35.562570 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-99fe5547-ca2f-47bf-89ed-689d7f00e2f1 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:35.569536 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-99fe5547-ca2f-47bf-89ed-689d7f00e2f1 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:35.570033 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-99fe5547-ca2f-47bf-89ed-689d7f00e2f1 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:35.570831 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-99fe5547-ca2f-47bf-89ed-689d7f00e2f1 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:35.571760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-99fe5547-ca2f-47bf-89ed-689d7f00e2f1 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:35.572200 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-99fe5547-ca2f-47bf-89ed-689d7f00e2f1 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:35.572784 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-99fe5547-ca2f-47bf-89ed-689d7f00e2f1 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:35.866566 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-99fe5547-ca2f-47bf-89ed-689d7f00e2f1 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:35.879903 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-99fe5547-ca2f-47bf-89ed-689d7f00e2f1 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1313 microversion: 2.1 time: 0.321686 Aug 30 01:01:35.886528 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 32/57] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:35 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:35.895092 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-d7e1bcad-d3a5-49a5-83fd-4ce4c3eeb9f8 req-5a5fe8e8-29c0-4a23-abcc-86be092fafad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "463f5c61-231b-435d-b0ec-440e941d8ae1", "tag": "5eb7c376-7d0c-4333-90b3-56b8d45e7089"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:35.923068 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-d7e1bcad-d3a5-49a5-83fd-4ce4c3eeb9f8 req-5a5fe8e8-29c0-4a23-abcc-86be092fafad service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:35.923609 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-d7e1bcad-d3a5-49a5-83fd-4ce4c3eeb9f8 req-5a5fe8e8-29c0-4a23-abcc-86be092fafad service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:35.924044 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-d7e1bcad-d3a5-49a5-83fd-4ce4c3eeb9f8 req-5a5fe8e8-29c0-4a23-abcc-86be092fafad service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:35.951108 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-d7e1bcad-d3a5-49a5-83fd-4ce4c3eeb9f8 req-5a5fe8e8-29c0-4a23-abcc-86be092fafad service nova] Creating event network-changed:5eb7c376-7d0c-4333-90b3-56b8d45e7089 for instance 463f5c61-231b-435d-b0ec-440e941d8ae1 on hv-cinder-81514 Aug 30 01:01:35.966949 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-d7e1bcad-d3a5-49a5-83fd-4ce4c3eeb9f8 req-5a5fe8e8-29c0-4a23-abcc-86be092fafad service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078802 Aug 30 01:01:35.967934 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 33/58] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:36.002683 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-583650e9-5ce9-4897-b2b7-44f91d836856 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:36.003460 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-583650e9-5ce9-4897-b2b7-44f91d836856 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:36.035469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-583650e9-5ce9-4897-b2b7-44f91d836856 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:36.035816 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-583650e9-5ce9-4897-b2b7-44f91d836856 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:36.036970 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-583650e9-5ce9-4897-b2b7-44f91d836856 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:36.037787 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-583650e9-5ce9-4897-b2b7-44f91d836856 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:36.038458 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-583650e9-5ce9-4897-b2b7-44f91d836856 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:36.038892 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-583650e9-5ce9-4897-b2b7-44f91d836856 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:36.311592 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-583650e9-5ce9-4897-b2b7-44f91d836856 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:36.322306 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-583650e9-5ce9-4897-b2b7-44f91d836856 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1361 microversion: 2.1 time: 0.353144 Aug 30 01:01:36.322882 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-c1367363-6185-4aad-9a03-2c9ff95d5202 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Flavor limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:01:36.325507 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 34/59] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:35 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1361 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:36.325619 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-c1367363-6185-4aad-9a03-2c9ff95d5202 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Image limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:01:36.325619 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-c1367363-6185-4aad-9a03-2c9ff95d5202 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Flavor pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:01:36.325619 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-c1367363-6185-4aad-9a03-2c9ff95d5202 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Image pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:01:36.325619 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-c1367363-6185-4aad-9a03-2c9ff95d5202 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:01:36.352049 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c1367363-6185-4aad-9a03-2c9ff95d5202 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:36.352849 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c1367363-6185-4aad-9a03-2c9ff95d5202 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:36.353347 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c1367363-6185-4aad-9a03-2c9ff95d5202 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:36.354334 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c1367363-6185-4aad-9a03-2c9ff95d5202 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:36.354795 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c1367363-6185-4aad-9a03-2c9ff95d5202 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:36.355230 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c1367363-6185-4aad-9a03-2c9ff95d5202 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:36.375124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-c1367363-6185-4aad-9a03-2c9ff95d5202 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Getting quotas for project 0596692dbfb149139a1e72159c6f93db. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:01:36.382945 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-c1367363-6185-4aad-9a03-2c9ff95d5202 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Getting quotas for user cc7cf306aadb45d1b65252b53c86b612 and project 0596692dbfb149139a1e72159c6f93db. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:01:36.397712 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-c1367363-6185-4aad-9a03-2c9ff95d5202 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Going to run 1 instances... {{(pid=120631) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:01:36.400569 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-c1367363-6185-4aad-9a03-2c9ff95d5202 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6c817b5-c41c-4210-a963-172386e2e582',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120631) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:01:36.461998 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-c1367363-6185-4aad-9a03-2c9ff95d5202 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.582649 Aug 30 01:01:36.468751 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 26/60] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 30 01:01:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:01:36.474828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-b9ec8e44-6f52-4312-ab70-b1d7daa98d7a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:36.475446 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-b9ec8e44-6f52-4312-ab70-b1d7daa98d7a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:36.578429 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-2727fcc8-2bd3-4c29-98df-9ba8be556326 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:36.579349 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-2727fcc8-2bd3-4c29-98df-9ba8be556326 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:36.587809 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2727fcc8-2bd3-4c29-98df-9ba8be556326 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:36.588187 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2727fcc8-2bd3-4c29-98df-9ba8be556326 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:36.588630 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2727fcc8-2bd3-4c29-98df-9ba8be556326 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:36.589540 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2727fcc8-2bd3-4c29-98df-9ba8be556326 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:36.589796 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2727fcc8-2bd3-4c29-98df-9ba8be556326 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:36.592135 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-b9ec8e44-6f52-4312-ab70-b1d7daa98d7a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:36.597677 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2727fcc8-2bd3-4c29-98df-9ba8be556326 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:36.601942 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-b9ec8e44-6f52-4312-ab70-b1d7daa98d7a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1240 microversion: 2.1 time: 0.131548 Aug 30 01:01:36.603874 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 35/61] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:36 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1240 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:36.802192 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-2727fcc8-2bd3-4c29-98df-9ba8be556326 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:36.819533 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-2727fcc8-2bd3-4c29-98df-9ba8be556326 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1322 microversion: 2.1 time: 0.245510 Aug 30 01:01:36.820114 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 27/62] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:36 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:36.912860 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8a26dc7f-c8fa-4c7f-a436-1e09de88ab3b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:36.917143 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8a26dc7f-c8fa-4c7f-a436-1e09de88ab3b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:36.939548 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a26dc7f-c8fa-4c7f-a436-1e09de88ab3b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:36.943335 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a26dc7f-c8fa-4c7f-a436-1e09de88ab3b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:36.943906 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a26dc7f-c8fa-4c7f-a436-1e09de88ab3b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:36.944652 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a26dc7f-c8fa-4c7f-a436-1e09de88ab3b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:36.945424 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a26dc7f-c8fa-4c7f-a436-1e09de88ab3b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:36.947585 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a26dc7f-c8fa-4c7f-a436-1e09de88ab3b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:37.214643 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8a26dc7f-c8fa-4c7f-a436-1e09de88ab3b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:37.225893 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8a26dc7f-c8fa-4c7f-a436-1e09de88ab3b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1313 microversion: 2.1 time: 0.319955 Aug 30 01:01:37.227148 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 36/63] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:36 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:37.355464 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-719bab4f-2133-43bf-90b6-cd465b93c96d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:37.364635 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-719bab4f-2133-43bf-90b6-cd465b93c96d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:37.384854 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-719bab4f-2133-43bf-90b6-cd465b93c96d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:37.386894 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-719bab4f-2133-43bf-90b6-cd465b93c96d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:37.388207 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-719bab4f-2133-43bf-90b6-cd465b93c96d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:37.392976 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-719bab4f-2133-43bf-90b6-cd465b93c96d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:37.393775 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-719bab4f-2133-43bf-90b6-cd465b93c96d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:37.394314 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-719bab4f-2133-43bf-90b6-cd465b93c96d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:37.632852 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-cd94e887-d573-4c3c-9576-a9932db8b3da tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:37.633734 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-cd94e887-d573-4c3c-9576-a9932db8b3da tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:37.643473 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cd94e887-d573-4c3c-9576-a9932db8b3da tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:37.644302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cd94e887-d573-4c3c-9576-a9932db8b3da tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:37.644894 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cd94e887-d573-4c3c-9576-a9932db8b3da tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:37.645730 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cd94e887-d573-4c3c-9576-a9932db8b3da tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:37.646276 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cd94e887-d573-4c3c-9576-a9932db8b3da tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:37.646818 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cd94e887-d573-4c3c-9576-a9932db8b3da tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:37.667739 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-719bab4f-2133-43bf-90b6-cd465b93c96d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:37.679826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-719bab4f-2133-43bf-90b6-cd465b93c96d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1361 microversion: 2.1 time: 0.338455 Aug 30 01:01:37.680889 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 28/64] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:37 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1361 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:37.765869 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-cd94e887-d573-4c3c-9576-a9932db8b3da tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:37.777380 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-cd94e887-d573-4c3c-9576-a9932db8b3da tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1244 microversion: 2.1 time: 0.156594 Aug 30 01:01:37.778717 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 37/65] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:37 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1244 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:01:37.845098 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-2203e8b4-2e1f-4bb3-8bbe-a8d10c53bd9e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:37.845705 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-2203e8b4-2e1f-4bb3-8bbe-a8d10c53bd9e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:37.855893 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2203e8b4-2e1f-4bb3-8bbe-a8d10c53bd9e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:37.856393 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2203e8b4-2e1f-4bb3-8bbe-a8d10c53bd9e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:37.856830 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2203e8b4-2e1f-4bb3-8bbe-a8d10c53bd9e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:37.857585 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2203e8b4-2e1f-4bb3-8bbe-a8d10c53bd9e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:37.858041 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2203e8b4-2e1f-4bb3-8bbe-a8d10c53bd9e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:37.858462 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2203e8b4-2e1f-4bb3-8bbe-a8d10c53bd9e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:38.180597 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-2203e8b4-2e1f-4bb3-8bbe-a8d10c53bd9e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:38.196577 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-2203e8b4-2e1f-4bb3-8bbe-a8d10c53bd9e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1322 microversion: 2.1 time: 0.355836 Aug 30 01:01:38.197671 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 29/66] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:37 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:38.270374 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-aabc48a4-0ab2-4783-8cc6-1ec1e87adb85 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:38.271192 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-aabc48a4-0ab2-4783-8cc6-1ec1e87adb85 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:38.291050 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aabc48a4-0ab2-4783-8cc6-1ec1e87adb85 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:38.292808 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aabc48a4-0ab2-4783-8cc6-1ec1e87adb85 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:38.292808 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aabc48a4-0ab2-4783-8cc6-1ec1e87adb85 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:38.294412 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aabc48a4-0ab2-4783-8cc6-1ec1e87adb85 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:38.294896 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aabc48a4-0ab2-4783-8cc6-1ec1e87adb85 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:38.295334 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aabc48a4-0ab2-4783-8cc6-1ec1e87adb85 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:38.588979 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-aabc48a4-0ab2-4783-8cc6-1ec1e87adb85 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:38.598943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-aabc48a4-0ab2-4783-8cc6-1ec1e87adb85 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1313 microversion: 2.1 time: 0.346305 Aug 30 01:01:38.605034 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 38/67] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:38 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:38.702106 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-cf256370-36ae-4f4b-a59c-045d9afb9ee9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:38.703621 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-cf256370-36ae-4f4b-a59c-045d9afb9ee9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:38.711887 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:38.714278 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cf256370-36ae-4f4b-a59c-045d9afb9ee9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:38.716748 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cf256370-36ae-4f4b-a59c-045d9afb9ee9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:38.718259 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cf256370-36ae-4f4b-a59c-045d9afb9ee9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:38.723385 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cf256370-36ae-4f4b-a59c-045d9afb9ee9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:38.724056 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cf256370-36ae-4f4b-a59c-045d9afb9ee9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:38.724651 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cf256370-36ae-4f4b-a59c-045d9afb9ee9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:38.809816 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-a1bff625-504e-466b-9cd1-b8b3480a8eb9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:38.812018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-a1bff625-504e-466b-9cd1-b8b3480a8eb9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:38.822122 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a1bff625-504e-466b-9cd1-b8b3480a8eb9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:38.822628 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a1bff625-504e-466b-9cd1-b8b3480a8eb9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:38.823404 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a1bff625-504e-466b-9cd1-b8b3480a8eb9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:38.825267 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a1bff625-504e-466b-9cd1-b8b3480a8eb9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:38.825877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a1bff625-504e-466b-9cd1-b8b3480a8eb9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:38.826441 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a1bff625-504e-466b-9cd1-b8b3480a8eb9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:38.989935 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-a1bff625-504e-466b-9cd1-b8b3480a8eb9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:39.004006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-a1bff625-504e-466b-9cd1-b8b3480a8eb9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1244 microversion: 2.1 time: 0.203711 Aug 30 01:01:39.004577 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 39/68] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:38 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1244 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:01:39.068830 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-cf256370-36ae-4f4b-a59c-045d9afb9ee9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:39.082637 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-cf256370-36ae-4f4b-a59c-045d9afb9ee9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1361 microversion: 2.1 time: 0.384809 Aug 30 01:01:39.083324 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 30/69] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:38 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1361 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:39.222336 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-78c1040a-5c14-43ef-8dc7-c8f00244e22a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:39.223388 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-78c1040a-5c14-43ef-8dc7-c8f00244e22a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:39.232671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-78c1040a-5c14-43ef-8dc7-c8f00244e22a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:39.233228 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-78c1040a-5c14-43ef-8dc7-c8f00244e22a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:39.233791 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-78c1040a-5c14-43ef-8dc7-c8f00244e22a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:39.234357 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-78c1040a-5c14-43ef-8dc7-c8f00244e22a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:39.235234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-78c1040a-5c14-43ef-8dc7-c8f00244e22a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:39.237816 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-78c1040a-5c14-43ef-8dc7-c8f00244e22a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:39.448420 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-78c1040a-5c14-43ef-8dc7-c8f00244e22a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:39.459649 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-78c1040a-5c14-43ef-8dc7-c8f00244e22a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1322 microversion: 2.1 time: 0.244381 Aug 30 01:01:39.460620 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 40/70] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:39 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:39.630327 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-9eef1029-7cb6-468f-8497-57e25d8169ef tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:39.630944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-9eef1029-7cb6-468f-8497-57e25d8169ef tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:39.637883 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9eef1029-7cb6-468f-8497-57e25d8169ef tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:39.638331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9eef1029-7cb6-468f-8497-57e25d8169ef tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:39.638939 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9eef1029-7cb6-468f-8497-57e25d8169ef tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:39.639631 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9eef1029-7cb6-468f-8497-57e25d8169ef tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:39.640083 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9eef1029-7cb6-468f-8497-57e25d8169ef tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:39.640497 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9eef1029-7cb6-468f-8497-57e25d8169ef tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:39.824480 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-9eef1029-7cb6-468f-8497-57e25d8169ef tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:39.833176 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-9eef1029-7cb6-468f-8497-57e25d8169ef tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1313 microversion: 2.1 time: 0.208956 Aug 30 01:01:39.837120 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 31/71] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:39 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:40.032200 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-1bfc8e5d-9620-47bc-aad5-84d17c54fc92 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:40.032814 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-1bfc8e5d-9620-47bc-aad5-84d17c54fc92 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:40.041268 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1bfc8e5d-9620-47bc-aad5-84d17c54fc92 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:40.042012 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1bfc8e5d-9620-47bc-aad5-84d17c54fc92 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:40.043383 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1bfc8e5d-9620-47bc-aad5-84d17c54fc92 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:40.044528 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1bfc8e5d-9620-47bc-aad5-84d17c54fc92 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:40.044996 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1bfc8e5d-9620-47bc-aad5-84d17c54fc92 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:40.045500 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1bfc8e5d-9620-47bc-aad5-84d17c54fc92 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:40.107195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0a08aa4c-19b5-4e9c-a455-be9d58c96425 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:40.108206 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-0a08aa4c-19b5-4e9c-a455-be9d58c96425 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:40.119189 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0a08aa4c-19b5-4e9c-a455-be9d58c96425 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:40.119857 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0a08aa4c-19b5-4e9c-a455-be9d58c96425 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:40.120389 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0a08aa4c-19b5-4e9c-a455-be9d58c96425 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:40.121202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0a08aa4c-19b5-4e9c-a455-be9d58c96425 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:40.122981 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0a08aa4c-19b5-4e9c-a455-be9d58c96425 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:40.123469 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0a08aa4c-19b5-4e9c-a455-be9d58c96425 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:40.130670 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-1bfc8e5d-9620-47bc-aad5-84d17c54fc92 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:40.138573 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-1bfc8e5d-9620-47bc-aad5-84d17c54fc92 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1244 microversion: 2.1 time: 0.111477 Aug 30 01:01:40.153376 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 41/72] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:40 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1244 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:40.293506 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-0a08aa4c-19b5-4e9c-a455-be9d58c96425 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:40.302770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0a08aa4c-19b5-4e9c-a455-be9d58c96425 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1361 microversion: 2.1 time: 0.202678 Aug 30 01:01:40.303845 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 32/73] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:40 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1361 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:01:40.482552 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f659241f-3a5a-4c51-8f45-745d5b657c6b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:40.483216 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-f659241f-3a5a-4c51-8f45-745d5b657c6b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:40.490546 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f659241f-3a5a-4c51-8f45-745d5b657c6b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:40.491030 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f659241f-3a5a-4c51-8f45-745d5b657c6b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:40.491480 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f659241f-3a5a-4c51-8f45-745d5b657c6b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:40.492153 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f659241f-3a5a-4c51-8f45-745d5b657c6b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:40.492606 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f659241f-3a5a-4c51-8f45-745d5b657c6b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:40.493022 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f659241f-3a5a-4c51-8f45-745d5b657c6b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:40.722809 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-f659241f-3a5a-4c51-8f45-745d5b657c6b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:40.726508 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=100 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:40.732352 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-f659241f-3a5a-4c51-8f45-745d5b657c6b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1322 microversion: 2.1 time: 0.254476 Aug 30 01:01:40.742900 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 42/74] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:40 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:40.856336 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-9e6fa340-2bb7-4e91-9ca3-9a19831e2662 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:40.857253 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-9e6fa340-2bb7-4e91-9ca3-9a19831e2662 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:40.880595 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9e6fa340-2bb7-4e91-9ca3-9a19831e2662 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:40.882420 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9e6fa340-2bb7-4e91-9ca3-9a19831e2662 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:40.883809 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9e6fa340-2bb7-4e91-9ca3-9a19831e2662 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:40.885847 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9e6fa340-2bb7-4e91-9ca3-9a19831e2662 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:40.887710 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9e6fa340-2bb7-4e91-9ca3-9a19831e2662 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:40.889008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9e6fa340-2bb7-4e91-9ca3-9a19831e2662 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:40.919179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=100 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:41.162919 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-5b3afd0e-bf88-4620-9e08-a91dd0cee171 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:41.164170 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-5b3afd0e-bf88-4620-9e08-a91dd0cee171 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:41.176764 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:41.182488 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5b3afd0e-bf88-4620-9e08-a91dd0cee171 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:41.183288 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5b3afd0e-bf88-4620-9e08-a91dd0cee171 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:41.183900 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5b3afd0e-bf88-4620-9e08-a91dd0cee171 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:41.185137 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5b3afd0e-bf88-4620-9e08-a91dd0cee171 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:41.194096 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5b3afd0e-bf88-4620-9e08-a91dd0cee171 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:41.195220 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5b3afd0e-bf88-4620-9e08-a91dd0cee171 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:41.254101 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-9e6fa340-2bb7-4e91-9ca3-9a19831e2662 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:41.265517 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-9e6fa340-2bb7-4e91-9ca3-9a19831e2662 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1313 microversion: 2.1 time: 0.413659 Aug 30 01:01:41.271492 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 33/75] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:40 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:41.325388 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-4b854988-3eaf-4cb3-b0ed-fc88553fc58b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:41.326476 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-4b854988-3eaf-4cb3-b0ed-fc88553fc58b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:41.341061 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4b854988-3eaf-4cb3-b0ed-fc88553fc58b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:41.341061 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4b854988-3eaf-4cb3-b0ed-fc88553fc58b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:41.341061 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4b854988-3eaf-4cb3-b0ed-fc88553fc58b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:41.341061 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4b854988-3eaf-4cb3-b0ed-fc88553fc58b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:41.341545 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4b854988-3eaf-4cb3-b0ed-fc88553fc58b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:41.341545 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4b854988-3eaf-4cb3-b0ed-fc88553fc58b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:41.528064 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-5b3afd0e-bf88-4620-9e08-a91dd0cee171 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:41.549388 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-5b3afd0e-bf88-4620-9e08-a91dd0cee171 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1292 microversion: 2.1 time: 0.386714 Aug 30 01:01:41.550504 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 43/76] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:41 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1292 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:41.768387 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-9b56272c-9021-4b54-b39d-a237082dab78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:41.769323 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-9b56272c-9021-4b54-b39d-a237082dab78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:41.777591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9b56272c-9021-4b54-b39d-a237082dab78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:41.778469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9b56272c-9021-4b54-b39d-a237082dab78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:41.779314 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9b56272c-9021-4b54-b39d-a237082dab78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:41.780989 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9b56272c-9021-4b54-b39d-a237082dab78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:41.782623 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9b56272c-9021-4b54-b39d-a237082dab78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:41.784429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9b56272c-9021-4b54-b39d-a237082dab78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:42.020427 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-4b854988-3eaf-4cb3-b0ed-fc88553fc58b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:42.030304 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-4b854988-3eaf-4cb3-b0ed-fc88553fc58b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1361 microversion: 2.1 time: 0.709671 Aug 30 01:01:42.031780 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 34/77] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:41 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1361 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:42.061208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-31dc6f15-f320-4352-b0fa-633d926b0c9d req-557333f7-ae97-4a0c-ae1e-02c8af85f5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b59fedac-4fcb-47a8-8187-0a331d499fd2", "tag": "26facd73-81ff-4a35-9126-739f3f31881b"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:42.094349 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-31dc6f15-f320-4352-b0fa-633d926b0c9d req-557333f7-ae97-4a0c-ae1e-02c8af85f5e7 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:42.095017 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-31dc6f15-f320-4352-b0fa-633d926b0c9d req-557333f7-ae97-4a0c-ae1e-02c8af85f5e7 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:42.095462 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-31dc6f15-f320-4352-b0fa-633d926b0c9d req-557333f7-ae97-4a0c-ae1e-02c8af85f5e7 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:42.126484 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-31dc6f15-f320-4352-b0fa-633d926b0c9d req-557333f7-ae97-4a0c-ae1e-02c8af85f5e7 service nova] Creating event network-changed:26facd73-81ff-4a35-9126-739f3f31881b for instance b59fedac-4fcb-47a8-8187-0a331d499fd2 on hv-cinder-81514 Aug 30 01:01:42.127233 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-31dc6f15-f320-4352-b0fa-633d926b0c9d req-557333f7-ae97-4a0c-ae1e-02c8af85f5e7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120631) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 01:01:42.127805 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-31dc6f15-f320-4352-b0fa-633d926b0c9d req-557333f7-ae97-4a0c-ae1e-02c8af85f5e7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120631) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 01:01:42.129069 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-69da2544-3a28-4fa6-9e11-f26435987716 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:42.129846 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-69da2544-3a28-4fa6-9e11-f26435987716 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:42.130378 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-69da2544-3a28-4fa6-9e11-f26435987716 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:42.131885 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-69da2544-3a28-4fa6-9e11-f26435987716 None None] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:42.132987 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-69da2544-3a28-4fa6-9e11-f26435987716 None None] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:42.133590 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-69da2544-3a28-4fa6-9e11-f26435987716 None None] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:42.150172 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.compute.rpcapi [None req-69da2544-3a28-4fa6-9e11-f26435987716 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 01:01:42.153848 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-9b56272c-9021-4b54-b39d-a237082dab78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:42.154007 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-69da2544-3a28-4fa6-9e11-f26435987716 None None] Releasing lock "compute-rpcapi-router" {{(pid=120631) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 01:01:42.163617 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-9b56272c-9021-4b54-b39d-a237082dab78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1322 microversion: 2.1 time: 0.403345 Aug 30 01:01:42.166267 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 44/78] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:41 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1322 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:42.202279 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-69da2544-3a28-4fa6-9e11-f26435987716 None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167283 Aug 30 01:01:42.204852 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 35/79] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:42.292205 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-22b724e4-278c-4c8f-802a-f3352871d5a3 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:42.293019 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-22b724e4-278c-4c8f-802a-f3352871d5a3 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:42.303186 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-22b724e4-278c-4c8f-802a-f3352871d5a3 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:42.305696 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-22b724e4-278c-4c8f-802a-f3352871d5a3 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:42.308539 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-22b724e4-278c-4c8f-802a-f3352871d5a3 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:42.311557 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-22b724e4-278c-4c8f-802a-f3352871d5a3 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:42.312221 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-22b724e4-278c-4c8f-802a-f3352871d5a3 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:42.313708 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-22b724e4-278c-4c8f-802a-f3352871d5a3 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:42.572695 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-a695b669-5e8d-4cbf-bdb7-14fbfa5e759e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:42.574133 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-a695b669-5e8d-4cbf-bdb7-14fbfa5e759e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:42.586876 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a695b669-5e8d-4cbf-bdb7-14fbfa5e759e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:42.587563 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a695b669-5e8d-4cbf-bdb7-14fbfa5e759e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:42.588148 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a695b669-5e8d-4cbf-bdb7-14fbfa5e759e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:42.590197 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a695b669-5e8d-4cbf-bdb7-14fbfa5e759e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:42.590830 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a695b669-5e8d-4cbf-bdb7-14fbfa5e759e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:42.591409 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a695b669-5e8d-4cbf-bdb7-14fbfa5e759e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:42.728853 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-a695b669-5e8d-4cbf-bdb7-14fbfa5e759e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:42.748646 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-a695b669-5e8d-4cbf-bdb7-14fbfa5e759e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1292 microversion: 2.1 time: 0.180608 Aug 30 01:01:42.765724 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 36/80] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:42 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1292 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:01:42.778498 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-22b724e4-278c-4c8f-802a-f3352871d5a3 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:42.797727 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-22b724e4-278c-4c8f-802a-f3352871d5a3 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1313 microversion: 2.1 time: 0.507512 Aug 30 01:01:42.798830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 45/81] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:42 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1313 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:43.052423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8925363d-39c9-47a8-8aef-6823ec176121 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:43.053040 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8925363d-39c9-47a8-8aef-6823ec176121 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:43.060645 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8925363d-39c9-47a8-8aef-6823ec176121 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:43.061190 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8925363d-39c9-47a8-8aef-6823ec176121 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:43.061628 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8925363d-39c9-47a8-8aef-6823ec176121 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:43.062329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8925363d-39c9-47a8-8aef-6823ec176121 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:43.063397 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8925363d-39c9-47a8-8aef-6823ec176121 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:43.063824 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8925363d-39c9-47a8-8aef-6823ec176121 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:43.230584 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=6 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:43.281409 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-cfa473f9-7e58-49bc-8351-fc2961cd5e5e req-1f998a85-6def-443e-8740-0bead09893d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "377d6898-d51c-4029-b9ce-3c96e2840dfd", "tag": "77835519-6f8f-47e8-9710-2b48c7087257"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:43.300320 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-cfa473f9-7e58-49bc-8351-fc2961cd5e5e req-1f998a85-6def-443e-8740-0bead09893d2 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:43.300802 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-cfa473f9-7e58-49bc-8351-fc2961cd5e5e req-1f998a85-6def-443e-8740-0bead09893d2 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:43.301593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-cfa473f9-7e58-49bc-8351-fc2961cd5e5e req-1f998a85-6def-443e-8740-0bead09893d2 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:43.329514 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-cfa473f9-7e58-49bc-8351-fc2961cd5e5e req-1f998a85-6def-443e-8740-0bead09893d2 service nova] Creating event network-changed:77835519-6f8f-47e8-9710-2b48c7087257 for instance 377d6898-d51c-4029-b9ce-3c96e2840dfd on hv-cinder-81514 Aug 30 01:01:43.343539 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-cfa473f9-7e58-49bc-8351-fc2961cd5e5e req-1f998a85-6def-443e-8740-0bead09893d2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.587089 Aug 30 01:01:43.344475 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 37/82] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:43.356447 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-6aa8df05-510a-4533-9536-c86be1e3d4fa tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:43.357173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-6aa8df05-510a-4533-9536-c86be1e3d4fa tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:43.373370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6aa8df05-510a-4533-9536-c86be1e3d4fa tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:43.373861 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6aa8df05-510a-4533-9536-c86be1e3d4fa tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:43.374296 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6aa8df05-510a-4533-9536-c86be1e3d4fa tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:43.376605 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6aa8df05-510a-4533-9536-c86be1e3d4fa tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:43.381019 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6aa8df05-510a-4533-9536-c86be1e3d4fa tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:43.381545 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6aa8df05-510a-4533-9536-c86be1e3d4fa tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:44.007694 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8925363d-39c9-47a8-8aef-6823ec176121 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:44.021374 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8925363d-39c9-47a8-8aef-6823ec176121 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1361 microversion: 2.1 time: 0.972675 Aug 30 01:01:44.022243 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 46/83] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:43 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1361 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:01:44.027620 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4c5f68ce-1db7-4140-b2b9-b297aaacb943 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:44.028907 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-4c5f68ce-1db7-4140-b2b9-b297aaacb943 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:44.042657 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c5f68ce-1db7-4140-b2b9-b297aaacb943 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:44.043297 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c5f68ce-1db7-4140-b2b9-b297aaacb943 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:44.043742 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c5f68ce-1db7-4140-b2b9-b297aaacb943 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:44.044575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c5f68ce-1db7-4140-b2b9-b297aaacb943 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:44.045145 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c5f68ce-1db7-4140-b2b9-b297aaacb943 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:44.045585 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c5f68ce-1db7-4140-b2b9-b297aaacb943 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:44.072470 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6aa8df05-510a-4533-9536-c86be1e3d4fa tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:44.085098 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-6aa8df05-510a-4533-9536-c86be1e3d4fa tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1322 microversion: 2.1 time: 0.738549 Aug 30 01:01:44.085727 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 38/84] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:43 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1322 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:44.098541 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-d7dd7cd1-81f4-4cd3-863d-f191d124fdfd tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:44.099517 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-d7dd7cd1-81f4-4cd3-863d-f191d124fdfd tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:44.118648 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d7dd7cd1-81f4-4cd3-863d-f191d124fdfd tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:44.119203 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d7dd7cd1-81f4-4cd3-863d-f191d124fdfd tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:44.119814 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d7dd7cd1-81f4-4cd3-863d-f191d124fdfd tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:44.139443 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d7dd7cd1-81f4-4cd3-863d-f191d124fdfd tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:44.142945 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d7dd7cd1-81f4-4cd3-863d-f191d124fdfd tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:44.144346 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d7dd7cd1-81f4-4cd3-863d-f191d124fdfd tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:44.185850 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-4c5f68ce-1db7-4140-b2b9-b297aaacb943 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:44.199304 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-4c5f68ce-1db7-4140-b2b9-b297aaacb943 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1298 microversion: 2.1 time: 0.175927 Aug 30 01:01:44.199968 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 47/85] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:44 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1298 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:44.455369 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-d7dd7cd1-81f4-4cd3-863d-f191d124fdfd tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:44.468288 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-d7dd7cd1-81f4-4cd3-863d-f191d124fdfd tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1313 microversion: 2.1 time: 0.378565 Aug 30 01:01:44.487608 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 39/86] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:44 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:45.043999 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-1ae276ca-b4c2-4ff1-bfb6-0fae6c73ed53 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:45.045200 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-1ae276ca-b4c2-4ff1-bfb6-0fae6c73ed53 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:45.052702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1ae276ca-b4c2-4ff1-bfb6-0fae6c73ed53 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:45.054122 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1ae276ca-b4c2-4ff1-bfb6-0fae6c73ed53 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:45.054703 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1ae276ca-b4c2-4ff1-bfb6-0fae6c73ed53 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:45.055589 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1ae276ca-b4c2-4ff1-bfb6-0fae6c73ed53 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:45.056199 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1ae276ca-b4c2-4ff1-bfb6-0fae6c73ed53 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:45.056832 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1ae276ca-b4c2-4ff1-bfb6-0fae6c73ed53 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:45.108330 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-908dedf2-0387-4324-be90-41177669b21e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:45.109023 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-908dedf2-0387-4324-be90-41177669b21e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:45.115982 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-908dedf2-0387-4324-be90-41177669b21e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:45.121760 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-908dedf2-0387-4324-be90-41177669b21e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:45.122420 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-908dedf2-0387-4324-be90-41177669b21e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:45.123523 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-908dedf2-0387-4324-be90-41177669b21e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:45.123934 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-908dedf2-0387-4324-be90-41177669b21e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:45.124371 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-908dedf2-0387-4324-be90-41177669b21e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:45.468311 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-1ae276ca-b4c2-4ff1-bfb6-0fae6c73ed53 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:45.476368 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-1ae276ca-b4c2-4ff1-bfb6-0fae6c73ed53 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1361 microversion: 2.1 time: 0.436948 Aug 30 01:01:45.483140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-908dedf2-0387-4324-be90-41177669b21e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:45.490065 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 48/87] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:45 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1361 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:45.497783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-5437a780-e20e-4fb4-b9a7-bf3af7f988b8 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:45.502288 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-5437a780-e20e-4fb4-b9a7-bf3af7f988b8 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:45.503967 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-908dedf2-0387-4324-be90-41177669b21e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1322 microversion: 2.1 time: 0.398189 Aug 30 01:01:45.506305 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 40/88] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:45 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:01:45.513013 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-35573eb0-1e0a-4500-bebc-4c627d934ad4 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:45.514585 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-35573eb0-1e0a-4500-bebc-4c627d934ad4 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:45.519226 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5437a780-e20e-4fb4-b9a7-bf3af7f988b8 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:45.523041 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5437a780-e20e-4fb4-b9a7-bf3af7f988b8 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:45.523692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5437a780-e20e-4fb4-b9a7-bf3af7f988b8 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:45.524591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5437a780-e20e-4fb4-b9a7-bf3af7f988b8 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:45.525238 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5437a780-e20e-4fb4-b9a7-bf3af7f988b8 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:45.525796 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5437a780-e20e-4fb4-b9a7-bf3af7f988b8 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:45.534130 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-35573eb0-1e0a-4500-bebc-4c627d934ad4 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:45.535043 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-35573eb0-1e0a-4500-bebc-4c627d934ad4 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:45.536377 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-35573eb0-1e0a-4500-bebc-4c627d934ad4 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:45.536792 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-35573eb0-1e0a-4500-bebc-4c627d934ad4 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:45.539079 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-35573eb0-1e0a-4500-bebc-4c627d934ad4 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:45.539923 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-35573eb0-1e0a-4500-bebc-4c627d934ad4 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:45.713105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-5437a780-e20e-4fb4-b9a7-bf3af7f988b8 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:45.724050 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-5437a780-e20e-4fb4-b9a7-bf3af7f988b8 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1298 microversion: 2.1 time: 0.232844 Aug 30 01:01:45.737653 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 49/89] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:45 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1298 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:46.389431 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=6 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:46.501065 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-78fb2b65-f6b9-48d0-b26a-d3004633a56f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:46.501860 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-78fb2b65-f6b9-48d0-b26a-d3004633a56f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:46.517984 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-78fb2b65-f6b9-48d0-b26a-d3004633a56f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:46.522864 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-78fb2b65-f6b9-48d0-b26a-d3004633a56f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:46.523507 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-78fb2b65-f6b9-48d0-b26a-d3004633a56f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:46.524390 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-78fb2b65-f6b9-48d0-b26a-d3004633a56f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:46.524987 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-78fb2b65-f6b9-48d0-b26a-d3004633a56f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:46.525840 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-78fb2b65-f6b9-48d0-b26a-d3004633a56f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:46.564481 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-35573eb0-1e0a-4500-bebc-4c627d934ad4 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:46.575875 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-35573eb0-1e0a-4500-bebc-4c627d934ad4 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1313 microversion: 2.1 time: 1.065628 Aug 30 01:01:46.599690 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 41/90] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:45 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1313 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:46.602457 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=24 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:46.619626 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-d86c3523-501f-4be8-a4fd-4ce038850cbc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:46.623297 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-d86c3523-501f-4be8-a4fd-4ce038850cbc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:46.648537 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d86c3523-501f-4be8-a4fd-4ce038850cbc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:46.650305 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d86c3523-501f-4be8-a4fd-4ce038850cbc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:46.652178 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d86c3523-501f-4be8-a4fd-4ce038850cbc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:46.659405 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d86c3523-501f-4be8-a4fd-4ce038850cbc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:46.662956 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d86c3523-501f-4be8-a4fd-4ce038850cbc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:46.664607 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d86c3523-501f-4be8-a4fd-4ce038850cbc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:47.175621 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-78fb2b65-f6b9-48d0-b26a-d3004633a56f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:47.186883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-78fb2b65-f6b9-48d0-b26a-d3004633a56f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1361 microversion: 2.1 time: 0.689165 Aug 30 01:01:47.188882 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 50/91] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:46 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1361 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:01:47.217184 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-d86c3523-501f-4be8-a4fd-4ce038850cbc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:47.227430 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-d86c3523-501f-4be8-a4fd-4ce038850cbc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1322 microversion: 2.1 time: 0.620764 Aug 30 01:01:47.228349 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 42/92] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:46 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1322 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:47.241619 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-7ceba968-ebfa-4d50-8102-7538b9464bc1 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:47.242244 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-7ceba968-ebfa-4d50-8102-7538b9464bc1 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:47.251265 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7ceba968-ebfa-4d50-8102-7538b9464bc1 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:47.251790 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7ceba968-ebfa-4d50-8102-7538b9464bc1 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:47.252228 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7ceba968-ebfa-4d50-8102-7538b9464bc1 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:47.252947 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7ceba968-ebfa-4d50-8102-7538b9464bc1 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:47.253412 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7ceba968-ebfa-4d50-8102-7538b9464bc1 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:47.253837 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7ceba968-ebfa-4d50-8102-7538b9464bc1 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:47.396280 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-e8445562-c5ec-4eef-afb9-920fae26678c req-48b2cc17-2969-48ee-9fe4-f3be70afec19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12338ddc-349d-4f0b-b6d8-4bb83f19e320", "name": "network-vif-plugged", "status": "completed", "tag": "d60f2857-a480-4c65-88cc-9e8dd6a7cbf4"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:47.410956 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-e8445562-c5ec-4eef-afb9-920fae26678c req-48b2cc17-2969-48ee-9fe4-f3be70afec19 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:47.413432 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-e8445562-c5ec-4eef-afb9-920fae26678c req-48b2cc17-2969-48ee-9fe4-f3be70afec19 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:47.414080 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-e8445562-c5ec-4eef-afb9-920fae26678c req-48b2cc17-2969-48ee-9fe4-f3be70afec19 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:47.434129 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-7ceba968-ebfa-4d50-8102-7538b9464bc1 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:47.440090 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-e8445562-c5ec-4eef-afb9-920fae26678c req-48b2cc17-2969-48ee-9fe4-f3be70afec19 service nova] Creating event network-vif-plugged:d60f2857-a480-4c65-88cc-9e8dd6a7cbf4 for instance 12338ddc-349d-4f0b-b6d8-4bb83f19e320 on hv-cinder-81514 Aug 30 01:01:47.442192 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-7ceba968-ebfa-4d50-8102-7538b9464bc1 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1366 microversion: 2.1 time: 0.212599 Aug 30 01:01:47.442784 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 43/93] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:47 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:47.449726 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-e8445562-c5ec-4eef-afb9-920fae26678c req-48b2cc17-2969-48ee-9fe4-f3be70afec19 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.259205 Aug 30 01:01:47.452757 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 51/94] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:47.598165 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3db04237-df59-4c73-80c0-6d3f9d57e024 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:47.598768 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-3db04237-df59-4c73-80c0-6d3f9d57e024 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:47.616570 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3db04237-df59-4c73-80c0-6d3f9d57e024 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:47.617066 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3db04237-df59-4c73-80c0-6d3f9d57e024 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:47.617526 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3db04237-df59-4c73-80c0-6d3f9d57e024 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:47.618238 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3db04237-df59-4c73-80c0-6d3f9d57e024 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:47.618699 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3db04237-df59-4c73-80c0-6d3f9d57e024 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:47.619119 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3db04237-df59-4c73-80c0-6d3f9d57e024 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:48.173424 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3db04237-df59-4c73-80c0-6d3f9d57e024 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:48.190895 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3db04237-df59-4c73-80c0-6d3f9d57e024 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1313 microversion: 2.1 time: 0.597276 Aug 30 01:01:48.191493 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 44/95] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:47 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1313 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:48.211440 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-1680f256-7976-4cfc-a1ed-57c7696c7b64 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:48.212666 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-1680f256-7976-4cfc-a1ed-57c7696c7b64 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:48.222819 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1680f256-7976-4cfc-a1ed-57c7696c7b64 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:48.225261 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1680f256-7976-4cfc-a1ed-57c7696c7b64 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:48.226901 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1680f256-7976-4cfc-a1ed-57c7696c7b64 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:48.226901 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1680f256-7976-4cfc-a1ed-57c7696c7b64 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:48.228414 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1680f256-7976-4cfc-a1ed-57c7696c7b64 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:48.228991 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1680f256-7976-4cfc-a1ed-57c7696c7b64 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:48.256461 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-2df586a3-c3a9-432c-9bd2-7f6d3ffbf6df tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:48.257380 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-2df586a3-c3a9-432c-9bd2-7f6d3ffbf6df tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:48.268130 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2df586a3-c3a9-432c-9bd2-7f6d3ffbf6df tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:48.275590 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2df586a3-c3a9-432c-9bd2-7f6d3ffbf6df tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:48.276298 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2df586a3-c3a9-432c-9bd2-7f6d3ffbf6df tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:48.277396 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2df586a3-c3a9-432c-9bd2-7f6d3ffbf6df tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:48.280181 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2df586a3-c3a9-432c-9bd2-7f6d3ffbf6df tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:48.283030 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2df586a3-c3a9-432c-9bd2-7f6d3ffbf6df tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:48.648436 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-2df586a3-c3a9-432c-9bd2-7f6d3ffbf6df tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:48.657416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-2df586a3-c3a9-432c-9bd2-7f6d3ffbf6df tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1322 microversion: 2.1 time: 0.404871 Aug 30 01:01:48.658007 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 45/96] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:48 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:48.662706 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-5f6104f4-5756-446a-a38c-d55dac1426cc req-6a4fa336-58fd-4002-a256-f1da64aba61f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d2ed1b9-2567-4964-83fd-dd44533766ae", "tag": "d7e5e765-e1c7-48ec-8dcf-1d5e6de0b12b"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:48.676776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-5f6104f4-5756-446a-a38c-d55dac1426cc req-6a4fa336-58fd-4002-a256-f1da64aba61f service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:48.677700 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-5f6104f4-5756-446a-a38c-d55dac1426cc req-6a4fa336-58fd-4002-a256-f1da64aba61f service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:48.678305 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-5f6104f4-5756-446a-a38c-d55dac1426cc req-6a4fa336-58fd-4002-a256-f1da64aba61f service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:48.693804 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-5f6104f4-5756-446a-a38c-d55dac1426cc req-6a4fa336-58fd-4002-a256-f1da64aba61f service nova] Creating event network-changed:d7e5e765-e1c7-48ec-8dcf-1d5e6de0b12b for instance 8d2ed1b9-2567-4964-83fd-dd44533766ae on hv-cinder-81514 Aug 30 01:01:48.699580 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-5f6104f4-5756-446a-a38c-d55dac1426cc req-6a4fa336-58fd-4002-a256-f1da64aba61f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040449 Aug 30 01:01:48.701737 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 46/97] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:48.708140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-ac452c2f-dd0d-4601-81bf-29698a5ecdc6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:48.709273 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-ac452c2f-dd0d-4601-81bf-29698a5ecdc6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:48.717577 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ac452c2f-dd0d-4601-81bf-29698a5ecdc6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:48.718252 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ac452c2f-dd0d-4601-81bf-29698a5ecdc6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:48.718984 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ac452c2f-dd0d-4601-81bf-29698a5ecdc6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:48.719844 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ac452c2f-dd0d-4601-81bf-29698a5ecdc6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:48.720453 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ac452c2f-dd0d-4601-81bf-29698a5ecdc6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:48.721314 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ac452c2f-dd0d-4601-81bf-29698a5ecdc6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:48.884156 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-1680f256-7976-4cfc-a1ed-57c7696c7b64 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:48.892967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-1680f256-7976-4cfc-a1ed-57c7696c7b64 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1361 microversion: 2.1 time: 0.686430 Aug 30 01:01:48.905748 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 52/98] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:48 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1361 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:48.986605 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-ac452c2f-dd0d-4601-81bf-29698a5ecdc6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:48.995469 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-ac452c2f-dd0d-4601-81bf-29698a5ecdc6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1366 microversion: 2.1 time: 0.291898 Aug 30 01:01:48.996174 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 47/99] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:48 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:49.216663 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-ee7fdc8b-5d81-46ec-894d-57ea62258c6d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:49.217533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-ee7fdc8b-5d81-46ec-894d-57ea62258c6d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:49.226567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ee7fdc8b-5d81-46ec-894d-57ea62258c6d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:49.227200 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ee7fdc8b-5d81-46ec-894d-57ea62258c6d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:49.227791 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ee7fdc8b-5d81-46ec-894d-57ea62258c6d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:49.228766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ee7fdc8b-5d81-46ec-894d-57ea62258c6d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:49.229313 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ee7fdc8b-5d81-46ec-894d-57ea62258c6d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:49.229849 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ee7fdc8b-5d81-46ec-894d-57ea62258c6d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:49.415114 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-ee7fdc8b-5d81-46ec-894d-57ea62258c6d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:49.428116 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-ee7fdc8b-5d81-46ec-894d-57ea62258c6d tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1313 microversion: 2.1 time: 0.218554 Aug 30 01:01:49.429966 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 53/100] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:49 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:49.472449 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-d3be9d73-9bcb-4be4-aedc-a82c23a3bf34 req-c145ae5f-4b7b-4c85-8be4-afe0f94fdd6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "463f5c61-231b-435d-b0ec-440e941d8ae1", "name": "network-vif-plugged", "status": "completed", "tag": "5eb7c376-7d0c-4333-90b3-56b8d45e7089"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:49.485405 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-d3be9d73-9bcb-4be4-aedc-a82c23a3bf34 req-c145ae5f-4b7b-4c85-8be4-afe0f94fdd6a service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:49.485864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-d3be9d73-9bcb-4be4-aedc-a82c23a3bf34 req-c145ae5f-4b7b-4c85-8be4-afe0f94fdd6a service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:49.486477 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-d3be9d73-9bcb-4be4-aedc-a82c23a3bf34 req-c145ae5f-4b7b-4c85-8be4-afe0f94fdd6a service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:49.499528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-d3be9d73-9bcb-4be4-aedc-a82c23a3bf34 req-c145ae5f-4b7b-4c85-8be4-afe0f94fdd6a service nova] Creating event network-vif-plugged:5eb7c376-7d0c-4333-90b3-56b8d45e7089 for instance 463f5c61-231b-435d-b0ec-440e941d8ae1 on hv-cinder-81514 Aug 30 01:01:49.505121 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-d3be9d73-9bcb-4be4-aedc-a82c23a3bf34 req-c145ae5f-4b7b-4c85-8be4-afe0f94fdd6a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038224 Aug 30 01:01:49.506224 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 48/101] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:49.678378 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-30525bd0-cf4f-4711-831f-cdfa44611f33 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:49.678981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-30525bd0-cf4f-4711-831f-cdfa44611f33 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:49.684861 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-30525bd0-cf4f-4711-831f-cdfa44611f33 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:49.685376 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-30525bd0-cf4f-4711-831f-cdfa44611f33 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:49.685803 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-30525bd0-cf4f-4711-831f-cdfa44611f33 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:49.686485 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-30525bd0-cf4f-4711-831f-cdfa44611f33 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:49.687104 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-30525bd0-cf4f-4711-831f-cdfa44611f33 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:49.688375 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-30525bd0-cf4f-4711-831f-cdfa44611f33 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:49.865564 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-30525bd0-cf4f-4711-831f-cdfa44611f33 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:49.874938 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-30525bd0-cf4f-4711-831f-cdfa44611f33 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1322 microversion: 2.1 time: 0.200309 Aug 30 01:01:49.875564 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 54/102] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:49 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:49.917985 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-b9401fd6-81bb-4a0a-ae23-8e37f0313b13 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:49.918770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-b9401fd6-81bb-4a0a-ae23-8e37f0313b13 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:49.929689 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b9401fd6-81bb-4a0a-ae23-8e37f0313b13 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:49.930419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b9401fd6-81bb-4a0a-ae23-8e37f0313b13 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:49.930937 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b9401fd6-81bb-4a0a-ae23-8e37f0313b13 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:49.931751 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b9401fd6-81bb-4a0a-ae23-8e37f0313b13 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:49.932415 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b9401fd6-81bb-4a0a-ae23-8e37f0313b13 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:49.932918 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b9401fd6-81bb-4a0a-ae23-8e37f0313b13 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:50.017713 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-32325d69-7eb7-46d6-af85-6ea412c788dd tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:50.018329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-32325d69-7eb7-46d6-af85-6ea412c788dd tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:50.024462 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-32325d69-7eb7-46d6-af85-6ea412c788dd tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:50.025046 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-32325d69-7eb7-46d6-af85-6ea412c788dd tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:50.025530 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-32325d69-7eb7-46d6-af85-6ea412c788dd tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:50.026192 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-32325d69-7eb7-46d6-af85-6ea412c788dd tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:50.026637 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-32325d69-7eb7-46d6-af85-6ea412c788dd tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:50.028127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-32325d69-7eb7-46d6-af85-6ea412c788dd tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:50.130420 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-b9401fd6-81bb-4a0a-ae23-8e37f0313b13 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:50.139094 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-b9401fd6-81bb-4a0a-ae23-8e37f0313b13 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1361 microversion: 2.1 time: 0.227797 Aug 30 01:01:50.139738 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 49/103] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:49 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:50.204804 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-32325d69-7eb7-46d6-af85-6ea412c788dd tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:50.212743 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-32325d69-7eb7-46d6-af85-6ea412c788dd tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1366 microversion: 2.1 time: 0.199290 Aug 30 01:01:50.213336 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 55/104] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:50 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:50.460723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-6b778664-cf63-42cb-a762-872c4395eda3 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:50.461822 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-6b778664-cf63-42cb-a762-872c4395eda3 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:50.467875 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6b778664-cf63-42cb-a762-872c4395eda3 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:50.469196 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6b778664-cf63-42cb-a762-872c4395eda3 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:50.469920 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6b778664-cf63-42cb-a762-872c4395eda3 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:50.470936 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6b778664-cf63-42cb-a762-872c4395eda3 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:50.471499 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6b778664-cf63-42cb-a762-872c4395eda3 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:50.472140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6b778664-cf63-42cb-a762-872c4395eda3 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:50.619469 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6b778664-cf63-42cb-a762-872c4395eda3 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:50.629269 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-6b778664-cf63-42cb-a762-872c4395eda3 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1313 microversion: 2.1 time: 0.183479 Aug 30 01:01:50.630173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 50/105] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:50 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:50.898295 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-0990ea6b-dc3c-4e39-a081-b8767960188f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:50.899898 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-0990ea6b-dc3c-4e39-a081-b8767960188f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:50.909654 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0990ea6b-dc3c-4e39-a081-b8767960188f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:50.910316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0990ea6b-dc3c-4e39-a081-b8767960188f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:50.910948 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0990ea6b-dc3c-4e39-a081-b8767960188f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:50.911948 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0990ea6b-dc3c-4e39-a081-b8767960188f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:50.912600 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0990ea6b-dc3c-4e39-a081-b8767960188f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:50.913087 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0990ea6b-dc3c-4e39-a081-b8767960188f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:51.055052 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-0990ea6b-dc3c-4e39-a081-b8767960188f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:51.062832 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-0990ea6b-dc3c-4e39-a081-b8767960188f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1322 microversion: 2.1 time: 0.169923 Aug 30 01:01:51.063401 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 56/106] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:50 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:51.160412 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-d42ba6ba-3664-44a8-9002-10881978172e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:51.161010 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-d42ba6ba-3664-44a8-9002-10881978172e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:51.166856 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d42ba6ba-3664-44a8-9002-10881978172e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:51.167333 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d42ba6ba-3664-44a8-9002-10881978172e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:51.167761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d42ba6ba-3664-44a8-9002-10881978172e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:51.168748 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d42ba6ba-3664-44a8-9002-10881978172e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:51.169216 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d42ba6ba-3664-44a8-9002-10881978172e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:51.169617 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d42ba6ba-3664-44a8-9002-10881978172e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:51.233519 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-039d6c55-dbde-4823-95df-d6cd21a54df2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:51.234752 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-039d6c55-dbde-4823-95df-d6cd21a54df2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:51.248512 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-039d6c55-dbde-4823-95df-d6cd21a54df2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:51.249013 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-039d6c55-dbde-4823-95df-d6cd21a54df2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:51.249511 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-039d6c55-dbde-4823-95df-d6cd21a54df2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:51.250254 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-039d6c55-dbde-4823-95df-d6cd21a54df2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:51.250845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-039d6c55-dbde-4823-95df-d6cd21a54df2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:51.251235 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-039d6c55-dbde-4823-95df-d6cd21a54df2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:51.413884 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-d42ba6ba-3664-44a8-9002-10881978172e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:51.423384 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-d42ba6ba-3664-44a8-9002-10881978172e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1361 microversion: 2.1 time: 0.267401 Aug 30 01:01:51.424272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 51/107] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:51 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:51.471409 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-039d6c55-dbde-4823-95df-d6cd21a54df2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:51.481607 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-039d6c55-dbde-4823-95df-d6cd21a54df2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1366 microversion: 2.1 time: 0.250626 Aug 30 01:01:51.487885 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 57/108] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:51 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:01:51.652523 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e4ac5762-1322-41ef-ad3c-41990193b4e5 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:51.653711 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e4ac5762-1322-41ef-ad3c-41990193b4e5 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:51.664407 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e4ac5762-1322-41ef-ad3c-41990193b4e5 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:51.665320 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e4ac5762-1322-41ef-ad3c-41990193b4e5 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:51.666040 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e4ac5762-1322-41ef-ad3c-41990193b4e5 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:51.667061 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e4ac5762-1322-41ef-ad3c-41990193b4e5 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:51.668259 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e4ac5762-1322-41ef-ad3c-41990193b4e5 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:51.669407 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e4ac5762-1322-41ef-ad3c-41990193b4e5 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:51.707081 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=100 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:52.070796 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e4ac5762-1322-41ef-ad3c-41990193b4e5 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:52.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-e7b29520-87b3-4222-ab44-ae47d3f9a95b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:52.087107 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-e7b29520-87b3-4222-ab44-ae47d3f9a95b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:52.098993 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e4ac5762-1322-41ef-ad3c-41990193b4e5 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1313 microversion: 2.1 time: 0.452080 Aug 30 01:01:52.099614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 52/109] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:51 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:52.100821 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e7b29520-87b3-4222-ab44-ae47d3f9a95b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:52.105441 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e7b29520-87b3-4222-ab44-ae47d3f9a95b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:52.106017 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e7b29520-87b3-4222-ab44-ae47d3f9a95b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:52.108400 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e7b29520-87b3-4222-ab44-ae47d3f9a95b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:52.109196 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e7b29520-87b3-4222-ab44-ae47d3f9a95b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:52.111702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e7b29520-87b3-4222-ab44-ae47d3f9a95b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:52.385218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-e7b29520-87b3-4222-ab44-ae47d3f9a95b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:52.396506 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-e7b29520-87b3-4222-ab44-ae47d3f9a95b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1322 microversion: 2.1 time: 0.314568 Aug 30 01:01:52.397126 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 58/110] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:52 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:52.445021 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0b9258cc-4472-4556-88c6-3462a2b19721 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:52.446216 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-0b9258cc-4472-4556-88c6-3462a2b19721 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:52.449426 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=4 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:52.460480 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b9258cc-4472-4556-88c6-3462a2b19721 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:52.460870 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b9258cc-4472-4556-88c6-3462a2b19721 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:52.461506 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b9258cc-4472-4556-88c6-3462a2b19721 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:52.463774 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b9258cc-4472-4556-88c6-3462a2b19721 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:52.464298 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b9258cc-4472-4556-88c6-3462a2b19721 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:52.464725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b9258cc-4472-4556-88c6-3462a2b19721 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:52.502795 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-41ad2886-5599-48c2-8262-6a60066bd0bf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:52.503498 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-41ad2886-5599-48c2-8262-6a60066bd0bf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:52.521985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-41ad2886-5599-48c2-8262-6a60066bd0bf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:52.522618 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-41ad2886-5599-48c2-8262-6a60066bd0bf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:52.523051 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-41ad2886-5599-48c2-8262-6a60066bd0bf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:52.523911 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-41ad2886-5599-48c2-8262-6a60066bd0bf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:52.524358 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-41ad2886-5599-48c2-8262-6a60066bd0bf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:52.524778 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-41ad2886-5599-48c2-8262-6a60066bd0bf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:52.652182 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-0b9258cc-4472-4556-88c6-3462a2b19721 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:52.661027 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0b9258cc-4472-4556-88c6-3462a2b19721 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1361 microversion: 2.1 time: 0.219730 Aug 30 01:01:52.666227 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 53/111] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:52 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1361 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:52.696826 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-41ad2886-5599-48c2-8262-6a60066bd0bf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:52.705791 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-41ad2886-5599-48c2-8262-6a60066bd0bf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1366 microversion: 2.1 time: 0.207536 Aug 30 01:01:52.706352 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 59/112] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:52 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:53.120002 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-7c54f02c-2c09-4654-8591-99ad40eb10ae tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:53.121195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-7c54f02c-2c09-4654-8591-99ad40eb10ae tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:53.128396 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7c54f02c-2c09-4654-8591-99ad40eb10ae tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:53.128774 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7c54f02c-2c09-4654-8591-99ad40eb10ae tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:53.129267 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7c54f02c-2c09-4654-8591-99ad40eb10ae tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:53.130217 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7c54f02c-2c09-4654-8591-99ad40eb10ae tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:53.130557 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7c54f02c-2c09-4654-8591-99ad40eb10ae tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:53.131016 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7c54f02c-2c09-4654-8591-99ad40eb10ae tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:53.371273 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-7c54f02c-2c09-4654-8591-99ad40eb10ae tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:53.384036 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-7c54f02c-2c09-4654-8591-99ad40eb10ae tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1313 microversion: 2.1 time: 0.268115 Aug 30 01:01:53.384802 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 54/113] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:53 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:53.421170 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-45899da1-0dc7-47ee-ae42-bb88851880b3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:53.422510 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-45899da1-0dc7-47ee-ae42-bb88851880b3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:53.428477 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-45899da1-0dc7-47ee-ae42-bb88851880b3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:53.429114 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-45899da1-0dc7-47ee-ae42-bb88851880b3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:53.429736 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-45899da1-0dc7-47ee-ae42-bb88851880b3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:53.430445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-45899da1-0dc7-47ee-ae42-bb88851880b3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:53.430906 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-45899da1-0dc7-47ee-ae42-bb88851880b3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:53.431335 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-45899da1-0dc7-47ee-ae42-bb88851880b3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:53.435739 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=100 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:53.611852 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-45899da1-0dc7-47ee-ae42-bb88851880b3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:53.620635 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-45899da1-0dc7-47ee-ae42-bb88851880b3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1322 microversion: 2.1 time: 0.207100 Aug 30 01:01:53.621416 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 60/114] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:53 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:53.682728 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0fb91734-88d2-4a75-b0b3-f7c562a1fe82 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:53.683340 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-0fb91734-88d2-4a75-b0b3-f7c562a1fe82 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:53.689390 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0fb91734-88d2-4a75-b0b3-f7c562a1fe82 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:53.690056 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0fb91734-88d2-4a75-b0b3-f7c562a1fe82 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:53.690678 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0fb91734-88d2-4a75-b0b3-f7c562a1fe82 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:53.691381 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0fb91734-88d2-4a75-b0b3-f7c562a1fe82 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:53.691839 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0fb91734-88d2-4a75-b0b3-f7c562a1fe82 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:53.692265 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0fb91734-88d2-4a75-b0b3-f7c562a1fe82 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:53.727073 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-897c52b4-36f0-49f9-bf6b-97cfd16e632d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:53.727684 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-897c52b4-36f0-49f9-bf6b-97cfd16e632d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:53.733795 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-897c52b4-36f0-49f9-bf6b-97cfd16e632d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:53.735124 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-897c52b4-36f0-49f9-bf6b-97cfd16e632d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:53.735563 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-897c52b4-36f0-49f9-bf6b-97cfd16e632d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:53.736264 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-897c52b4-36f0-49f9-bf6b-97cfd16e632d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:53.736712 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-897c52b4-36f0-49f9-bf6b-97cfd16e632d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:53.737157 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-897c52b4-36f0-49f9-bf6b-97cfd16e632d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:53.947201 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-0fb91734-88d2-4a75-b0b3-f7c562a1fe82 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:53.955220 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0fb91734-88d2-4a75-b0b3-f7c562a1fe82 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1361 microversion: 2.1 time: 0.276501 Aug 30 01:01:53.955805 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 55/115] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:53 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1361 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:53.969230 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-897c52b4-36f0-49f9-bf6b-97cfd16e632d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:53.972648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-897c52b4-36f0-49f9-bf6b-97cfd16e632d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1366 microversion: 2.1 time: 0.249340 Aug 30 01:01:53.973281 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 61/116] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:53 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:54.405389 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-a56ea3f6-58a1-4cf1-9317-2c218ce26b0b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:54.406992 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-a56ea3f6-58a1-4cf1-9317-2c218ce26b0b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:54.414392 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a56ea3f6-58a1-4cf1-9317-2c218ce26b0b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:54.415163 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a56ea3f6-58a1-4cf1-9317-2c218ce26b0b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:54.415836 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a56ea3f6-58a1-4cf1-9317-2c218ce26b0b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:54.416755 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a56ea3f6-58a1-4cf1-9317-2c218ce26b0b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:54.417455 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a56ea3f6-58a1-4cf1-9317-2c218ce26b0b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:54.418102 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a56ea3f6-58a1-4cf1-9317-2c218ce26b0b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:54.597589 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-a56ea3f6-58a1-4cf1-9317-2c218ce26b0b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:54.606178 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-a56ea3f6-58a1-4cf1-9317-2c218ce26b0b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1313 microversion: 2.1 time: 0.204547 Aug 30 01:01:54.617289 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 56/117] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:54 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:54.642565 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-611ec11a-133f-4a9c-b0a0-9a0cb00fb4c8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:54.643864 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-611ec11a-133f-4a9c-b0a0-9a0cb00fb4c8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:54.650578 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-611ec11a-133f-4a9c-b0a0-9a0cb00fb4c8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:54.651360 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-611ec11a-133f-4a9c-b0a0-9a0cb00fb4c8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:54.652254 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-611ec11a-133f-4a9c-b0a0-9a0cb00fb4c8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:54.653421 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-611ec11a-133f-4a9c-b0a0-9a0cb00fb4c8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:54.654019 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-611ec11a-133f-4a9c-b0a0-9a0cb00fb4c8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:54.654596 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-611ec11a-133f-4a9c-b0a0-9a0cb00fb4c8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:54.905976 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-611ec11a-133f-4a9c-b0a0-9a0cb00fb4c8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:54.920482 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-611ec11a-133f-4a9c-b0a0-9a0cb00fb4c8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1322 microversion: 2.1 time: 0.282441 Aug 30 01:01:54.923129 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 62/118] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:54 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:54.979168 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-46cee2fe-3c50-437b-9db9-e05b0a95b0a9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:54.980065 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-46cee2fe-3c50-437b-9db9-e05b0a95b0a9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:54.987668 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-46cee2fe-3c50-437b-9db9-e05b0a95b0a9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:54.994222 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f4daabd3-1d43-459d-b5c3-c7abd2369f79 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:54.995194 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-f4daabd3-1d43-459d-b5c3-c7abd2369f79 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:54.998616 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-46cee2fe-3c50-437b-9db9-e05b0a95b0a9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:55.002327 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-46cee2fe-3c50-437b-9db9-e05b0a95b0a9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:55.004796 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-46cee2fe-3c50-437b-9db9-e05b0a95b0a9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:55.006401 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f4daabd3-1d43-459d-b5c3-c7abd2369f79 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:55.006707 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-46cee2fe-3c50-437b-9db9-e05b0a95b0a9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:55.007419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-46cee2fe-3c50-437b-9db9-e05b0a95b0a9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:55.009342 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f4daabd3-1d43-459d-b5c3-c7abd2369f79 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:55.011467 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f4daabd3-1d43-459d-b5c3-c7abd2369f79 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:55.013185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f4daabd3-1d43-459d-b5c3-c7abd2369f79 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:55.015984 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f4daabd3-1d43-459d-b5c3-c7abd2369f79 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:55.016756 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f4daabd3-1d43-459d-b5c3-c7abd2369f79 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:55.241944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-46cee2fe-3c50-437b-9db9-e05b0a95b0a9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:55.253120 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-46cee2fe-3c50-437b-9db9-e05b0a95b0a9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1361 microversion: 2.1 time: 0.278186 Aug 30 01:01:55.254309 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 57/119] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:54 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1361 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:55.292294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-f4daabd3-1d43-459d-b5c3-c7abd2369f79 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:55.300292 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-f4daabd3-1d43-459d-b5c3-c7abd2369f79 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1366 microversion: 2.1 time: 0.310632 Aug 30 01:01:55.301248 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 63/120] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:54 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:01:55.629311 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-75c2724f-f8c9-401a-89be-ed8a07f48c3b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:55.630394 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-75c2724f-f8c9-401a-89be-ed8a07f48c3b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:55.641933 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-75c2724f-f8c9-401a-89be-ed8a07f48c3b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:55.642628 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-75c2724f-f8c9-401a-89be-ed8a07f48c3b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:55.643215 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-75c2724f-f8c9-401a-89be-ed8a07f48c3b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:55.643907 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-75c2724f-f8c9-401a-89be-ed8a07f48c3b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:55.644970 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-75c2724f-f8c9-401a-89be-ed8a07f48c3b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:55.645735 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-75c2724f-f8c9-401a-89be-ed8a07f48c3b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:55.800455 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-75c2724f-f8c9-401a-89be-ed8a07f48c3b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:55.811425 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-75c2724f-f8c9-401a-89be-ed8a07f48c3b tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1313 microversion: 2.1 time: 0.187335 Aug 30 01:01:55.822071 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 58/121] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:55 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:55.942385 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-dbae9ba8-e5d6-488a-90af-41124e4e1011 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:55.942985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-dbae9ba8-e5d6-488a-90af-41124e4e1011 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:55.949680 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dbae9ba8-e5d6-488a-90af-41124e4e1011 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:55.950350 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dbae9ba8-e5d6-488a-90af-41124e4e1011 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:55.951018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dbae9ba8-e5d6-488a-90af-41124e4e1011 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:55.951753 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dbae9ba8-e5d6-488a-90af-41124e4e1011 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:55.952356 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dbae9ba8-e5d6-488a-90af-41124e4e1011 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:55.953239 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dbae9ba8-e5d6-488a-90af-41124e4e1011 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:56.111951 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-dbae9ba8-e5d6-488a-90af-41124e4e1011 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:56.122508 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-dbae9ba8-e5d6-488a-90af-41124e4e1011 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1322 microversion: 2.1 time: 0.183893 Aug 30 01:01:56.126426 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 64/122] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:55 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:56.275114 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-8786741b-9017-48ab-8e09-164fdc9c1946 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:56.275729 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-8786741b-9017-48ab-8e09-164fdc9c1946 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:56.282640 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8786741b-9017-48ab-8e09-164fdc9c1946 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:56.283131 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8786741b-9017-48ab-8e09-164fdc9c1946 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:56.283569 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8786741b-9017-48ab-8e09-164fdc9c1946 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:56.284261 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8786741b-9017-48ab-8e09-164fdc9c1946 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:56.284871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8786741b-9017-48ab-8e09-164fdc9c1946 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:56.285466 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8786741b-9017-48ab-8e09-164fdc9c1946 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:56.291187 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-06a866d5-69ce-4697-88ff-d1b18ddcf411 req-7ea66729-92ea-4d70-837c-a9837f67a0a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59fedac-4fcb-47a8-8187-0a331d499fd2", "name": "network-vif-plugged", "status": "completed", "tag": "26facd73-81ff-4a35-9126-739f3f31881b"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:56.303056 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-06a866d5-69ce-4697-88ff-d1b18ddcf411 req-7ea66729-92ea-4d70-837c-a9837f67a0a2 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:56.303690 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-06a866d5-69ce-4697-88ff-d1b18ddcf411 req-7ea66729-92ea-4d70-837c-a9837f67a0a2 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:56.304133 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-06a866d5-69ce-4697-88ff-d1b18ddcf411 req-7ea66729-92ea-4d70-837c-a9837f67a0a2 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:56.320233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-06a866d5-69ce-4697-88ff-d1b18ddcf411 req-7ea66729-92ea-4d70-837c-a9837f67a0a2 service nova] Creating event network-vif-plugged:26facd73-81ff-4a35-9126-739f3f31881b for instance b59fedac-4fcb-47a8-8187-0a331d499fd2 on hv-cinder-81514 Aug 30 01:01:56.328840 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-06a866d5-69ce-4697-88ff-d1b18ddcf411 req-7ea66729-92ea-4d70-837c-a9837f67a0a2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040631 Aug 30 01:01:56.329796 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 65/123] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:01:56.348634 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-7e54ae21-ff97-4a32-99d3-34f5d990872f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:56.351071 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-7e54ae21-ff97-4a32-99d3-34f5d990872f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:56.363440 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7e54ae21-ff97-4a32-99d3-34f5d990872f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:56.363931 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7e54ae21-ff97-4a32-99d3-34f5d990872f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:56.364413 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7e54ae21-ff97-4a32-99d3-34f5d990872f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:56.365205 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7e54ae21-ff97-4a32-99d3-34f5d990872f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:56.366797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7e54ae21-ff97-4a32-99d3-34f5d990872f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:56.367498 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7e54ae21-ff97-4a32-99d3-34f5d990872f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:56.534846 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-8786741b-9017-48ab-8e09-164fdc9c1946 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:56.543912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-8786741b-9017-48ab-8e09-164fdc9c1946 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1361 microversion: 2.1 time: 0.272332 Aug 30 01:01:56.547073 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 59/124] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:56 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1361 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:56.587052 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7e54ae21-ff97-4a32-99d3-34f5d990872f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:56.596826 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-7e54ae21-ff97-4a32-99d3-34f5d990872f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1366 microversion: 2.1 time: 0.265743 Aug 30 01:01:56.597744 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 66/125] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:56 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:56.834949 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-1ed2d137-38a3-4b2a-bd36-cc194a9f16e6 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:56.835565 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-1ed2d137-38a3-4b2a-bd36-cc194a9f16e6 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:56.842582 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1ed2d137-38a3-4b2a-bd36-cc194a9f16e6 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:56.843075 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1ed2d137-38a3-4b2a-bd36-cc194a9f16e6 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:56.846754 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1ed2d137-38a3-4b2a-bd36-cc194a9f16e6 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:56.848186 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1ed2d137-38a3-4b2a-bd36-cc194a9f16e6 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:56.852511 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1ed2d137-38a3-4b2a-bd36-cc194a9f16e6 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:56.852957 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1ed2d137-38a3-4b2a-bd36-cc194a9f16e6 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:57.043505 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-1ed2d137-38a3-4b2a-bd36-cc194a9f16e6 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:57.052659 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-1ed2d137-38a3-4b2a-bd36-cc194a9f16e6 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1313 microversion: 2.1 time: 0.221573 Aug 30 01:01:57.053256 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 60/126] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:56 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:57.146514 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-d532b9ab-629c-43df-8e8f-3160f31827ca tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:57.147113 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-d532b9ab-629c-43df-8e8f-3160f31827ca tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:57.153294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d532b9ab-629c-43df-8e8f-3160f31827ca tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:57.154479 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d532b9ab-629c-43df-8e8f-3160f31827ca tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:57.154978 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d532b9ab-629c-43df-8e8f-3160f31827ca tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:57.156235 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d532b9ab-629c-43df-8e8f-3160f31827ca tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:57.156700 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d532b9ab-629c-43df-8e8f-3160f31827ca tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:57.157144 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d532b9ab-629c-43df-8e8f-3160f31827ca tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:57.324039 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-d532b9ab-629c-43df-8e8f-3160f31827ca tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:57.333112 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-d532b9ab-629c-43df-8e8f-3160f31827ca tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1322 microversion: 2.1 time: 0.189974 Aug 30 01:01:57.334085 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 67/127] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:57 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:57.429086 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-83a2150c-8387-4533-9a59-c8661d4848ec tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-99682745", "imageRef": "d6c817b5-c41c-4210-a963-172386e2e582", "flavorRef": "452", "networks": [{"uuid": "9d1e59dd-5b38-4842-838d-cef49c8c8701"}]}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:57.487414 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.network.neutron [None req-83a2150c-8387-4533-9a59-c8661d4848ec tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] validate_networks() for [('9d1e59dd-5b38-4842-838d-cef49c8c8701', None, None, None, None, None)] {{(pid=120631) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:01:57.568013 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-5e80c542-e2e5-4948-b3e3-da9a1ac228d5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:57.568992 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-5e80c542-e2e5-4948-b3e3-da9a1ac228d5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:57.575959 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5e80c542-e2e5-4948-b3e3-da9a1ac228d5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:57.579359 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5e80c542-e2e5-4948-b3e3-da9a1ac228d5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:57.579989 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5e80c542-e2e5-4948-b3e3-da9a1ac228d5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:57.580911 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5e80c542-e2e5-4948-b3e3-da9a1ac228d5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:57.581992 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5e80c542-e2e5-4948-b3e3-da9a1ac228d5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:57.582576 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5e80c542-e2e5-4948-b3e3-da9a1ac228d5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:57.848631 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-5e80c542-e2e5-4948-b3e3-da9a1ac228d5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:57.856711 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-5e80c542-e2e5-4948-b3e3-da9a1ac228d5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1361 microversion: 2.1 time: 0.292352 Aug 30 01:01:57.857430 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 68/128] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:57 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1361 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:01:57.862674 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-abb98b8a-20b9-45f5-9890-1b6ac6c3aa57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:57.863277 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-abb98b8a-20b9-45f5-9890-1b6ac6c3aa57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:57.876786 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-abb98b8a-20b9-45f5-9890-1b6ac6c3aa57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:57.877620 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-abb98b8a-20b9-45f5-9890-1b6ac6c3aa57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:57.878383 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-abb98b8a-20b9-45f5-9890-1b6ac6c3aa57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:57.879230 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-abb98b8a-20b9-45f5-9890-1b6ac6c3aa57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:57.879820 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-abb98b8a-20b9-45f5-9890-1b6ac6c3aa57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:57.880448 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-abb98b8a-20b9-45f5-9890-1b6ac6c3aa57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:58.457523 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-83a2150c-8387-4533-9a59-c8661d4848ec tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Flavor limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:01:58.458105 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-83a2150c-8387-4533-9a59-c8661d4848ec tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Image limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:01:58.458530 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-83a2150c-8387-4533-9a59-c8661d4848ec tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Flavor pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:01:58.458935 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-83a2150c-8387-4533-9a59-c8661d4848ec tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Image pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:01:58.459338 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-83a2150c-8387-4533-9a59-c8661d4848ec tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:01:58.483348 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-83a2150c-8387-4533-9a59-c8661d4848ec tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:58.484497 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-83a2150c-8387-4533-9a59-c8661d4848ec tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:58.485266 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-83a2150c-8387-4533-9a59-c8661d4848ec tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:58.486282 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-83a2150c-8387-4533-9a59-c8661d4848ec tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:58.486916 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-83a2150c-8387-4533-9a59-c8661d4848ec tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:58.487574 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-83a2150c-8387-4533-9a59-c8661d4848ec tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:58.552395 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-83a2150c-8387-4533-9a59-c8661d4848ec tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Getting quotas for project 2c18e1da199c437b809a45aada0b0e0e. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:01:58.558253 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-abb98b8a-20b9-45f5-9890-1b6ac6c3aa57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:58.566075 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-83a2150c-8387-4533-9a59-c8661d4848ec tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Getting quotas for user fed877b0a569455597dfbb8b98ae0bc0 and project 2c18e1da199c437b809a45aada0b0e0e. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:01:58.567303 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-abb98b8a-20b9-45f5-9890-1b6ac6c3aa57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1366 microversion: 2.1 time: 0.708699 Aug 30 01:01:58.586035 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 69/129] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:57 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1366 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:58.592749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-883ff902-6ba5-4bb1-8bc7-8d9319050060 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:58.597173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-83a2150c-8387-4533-9a59-c8661d4848ec tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Going to run 1 instances... {{(pid=120631) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:01:58.598194 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-883ff902-6ba5-4bb1-8bc7-8d9319050060 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:58.599494 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-83a2150c-8387-4533-9a59-c8661d4848ec tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6c817b5-c41c-4210-a963-172386e2e582',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120631) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:01:58.610396 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-883ff902-6ba5-4bb1-8bc7-8d9319050060 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:58.611322 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-883ff902-6ba5-4bb1-8bc7-8d9319050060 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:58.613971 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-883ff902-6ba5-4bb1-8bc7-8d9319050060 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:58.615854 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-883ff902-6ba5-4bb1-8bc7-8d9319050060 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:58.617192 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-883ff902-6ba5-4bb1-8bc7-8d9319050060 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:58.618491 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-883ff902-6ba5-4bb1-8bc7-8d9319050060 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:58.668992 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-83a2150c-8387-4533-9a59-c8661d4848ec tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.244064 Aug 30 01:01:58.677365 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 61/130] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 30 01:01:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 01:01:58.684982 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-99befee1-a955-4d0a-8543-08f41fee4b0b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:58.685921 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-99befee1-a955-4d0a-8543-08f41fee4b0b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:58.694579 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-99befee1-a955-4d0a-8543-08f41fee4b0b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:58.695334 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-99befee1-a955-4d0a-8543-08f41fee4b0b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:58.695942 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-99befee1-a955-4d0a-8543-08f41fee4b0b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:58.696708 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-99befee1-a955-4d0a-8543-08f41fee4b0b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:58.697197 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-99befee1-a955-4d0a-8543-08f41fee4b0b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:58.697631 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-99befee1-a955-4d0a-8543-08f41fee4b0b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:58.912069 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-883ff902-6ba5-4bb1-8bc7-8d9319050060 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:58.915220 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-99befee1-a955-4d0a-8543-08f41fee4b0b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:58.925573 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-99befee1-a955-4d0a-8543-08f41fee4b0b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1322 microversion: 2.1 time: 0.250789 Aug 30 01:01:58.926421 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 62/131] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:58 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:58.928523 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-883ff902-6ba5-4bb1-8bc7-8d9319050060 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1500 microversion: 2.1 time: 0.341118 Aug 30 01:01:58.931100 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 70/132] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:58 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1500 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:58.933813 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-4a4dcd53-d72e-4a01-8349-2d722b52bea1 req-4a42fbab-655b-4065-accd-155e541f171f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377d6898-d51c-4029-b9ce-3c96e2840dfd", "name": "network-vif-plugged", "status": "completed", "tag": "77835519-6f8f-47e8-9710-2b48c7087257"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:58.945129 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-4a4dcd53-d72e-4a01-8349-2d722b52bea1 req-4a42fbab-655b-4065-accd-155e541f171f service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:58.945614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-4a4dcd53-d72e-4a01-8349-2d722b52bea1 req-4a42fbab-655b-4065-accd-155e541f171f service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:58.946040 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-4a4dcd53-d72e-4a01-8349-2d722b52bea1 req-4a42fbab-655b-4065-accd-155e541f171f service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:58.951393 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-a3ec820b-0731-4088-9a8f-174355ada6c6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:58.952014 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-a3ec820b-0731-4088-9a8f-174355ada6c6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:58.959229 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-4a4dcd53-d72e-4a01-8349-2d722b52bea1 req-4a42fbab-655b-4065-accd-155e541f171f service nova] Creating event network-vif-plugged:77835519-6f8f-47e8-9710-2b48c7087257 for instance 377d6898-d51c-4029-b9ce-3c96e2840dfd on hv-cinder-81514 Aug 30 01:01:58.966837 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-4a4dcd53-d72e-4a01-8349-2d722b52bea1 req-4a42fbab-655b-4065-accd-155e541f171f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036879 Aug 30 01:01:58.972657 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 63/133] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:58.978212 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-9a885b98-108d-4c35-8615-03787a1b643d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:58.979183 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-9a885b98-108d-4c35-8615-03787a1b643d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:58.989849 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9a885b98-108d-4c35-8615-03787a1b643d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:58.990717 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9a885b98-108d-4c35-8615-03787a1b643d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:58.991304 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9a885b98-108d-4c35-8615-03787a1b643d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:58.992406 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9a885b98-108d-4c35-8615-03787a1b643d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:58.993000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9a885b98-108d-4c35-8615-03787a1b643d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:58.994011 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9a885b98-108d-4c35-8615-03787a1b643d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:59.009528 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-a3ec820b-0731-4088-9a8f-174355ada6c6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:59.017547 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-a3ec820b-0731-4088-9a8f-174355ada6c6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c" status: 200 len: 1212 microversion: 2.1 time: 0.085204 Aug 30 01:01:59.029436 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 71/134] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:58 2022] GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c => generated 1212 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:59.251167 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-9a885b98-108d-4c35-8615-03787a1b643d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:59.262621 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-9a885b98-108d-4c35-8615-03787a1b643d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1361 microversion: 2.1 time: 0.288436 Aug 30 01:01:59.263431 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 64/135] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:58 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1361 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:59.589231 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-bfe6f0bb-42e5-44ee-bbf3-2a9cfc175352 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:59.589851 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-bfe6f0bb-42e5-44ee-bbf3-2a9cfc175352 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:59.598412 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bfe6f0bb-42e5-44ee-bbf3-2a9cfc175352 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:59.599724 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bfe6f0bb-42e5-44ee-bbf3-2a9cfc175352 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:59.600353 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bfe6f0bb-42e5-44ee-bbf3-2a9cfc175352 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:59.602485 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bfe6f0bb-42e5-44ee-bbf3-2a9cfc175352 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:59.602485 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bfe6f0bb-42e5-44ee-bbf3-2a9cfc175352 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:59.602485 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bfe6f0bb-42e5-44ee-bbf3-2a9cfc175352 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:59.807819 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-bfe6f0bb-42e5-44ee-bbf3-2a9cfc175352 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:59.818383 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-bfe6f0bb-42e5-44ee-bbf3-2a9cfc175352 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1366 microversion: 2.1 time: 0.232676 Aug 30 01:01:59.819559 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 72/136] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:59 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:59.947259 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-ce4b81ba-b125-4fb7-9715-50077b35e5e3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:59.948481 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-ce4b81ba-b125-4fb7-9715-50077b35e5e3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:59.955396 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ce4b81ba-b125-4fb7-9715-50077b35e5e3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:59.955883 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ce4b81ba-b125-4fb7-9715-50077b35e5e3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:59.956315 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ce4b81ba-b125-4fb7-9715-50077b35e5e3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:59.957004 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ce4b81ba-b125-4fb7-9715-50077b35e5e3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:59.957637 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ce4b81ba-b125-4fb7-9715-50077b35e5e3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:59.958056 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ce4b81ba-b125-4fb7-9715-50077b35e5e3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:00.042143 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-6e4493ef-4311-4059-8323-8195c110aae4 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:00.043019 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-6e4493ef-4311-4059-8323-8195c110aae4 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:00.054840 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6e4493ef-4311-4059-8323-8195c110aae4 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:00.055336 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6e4493ef-4311-4059-8323-8195c110aae4 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:00.055778 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6e4493ef-4311-4059-8323-8195c110aae4 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:00.056479 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6e4493ef-4311-4059-8323-8195c110aae4 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:00.056933 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6e4493ef-4311-4059-8323-8195c110aae4 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:00.057387 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6e4493ef-4311-4059-8323-8195c110aae4 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:00.149592 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-6e4493ef-4311-4059-8323-8195c110aae4 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:00.173809 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-6e4493ef-4311-4059-8323-8195c110aae4 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c" status: 200 len: 1264 microversion: 2.1 time: 0.137276 Aug 30 01:02:00.175149 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 73/137] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:00 2022] GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:00.206897 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-ce4b81ba-b125-4fb7-9715-50077b35e5e3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:00.216667 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-ce4b81ba-b125-4fb7-9715-50077b35e5e3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1322 microversion: 2.1 time: 0.273098 Aug 30 01:02:00.217937 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 65/138] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:59 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:00.286642 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-a8742ce3-0b5a-4b74-b2d5-2dc695569ee8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:00.287510 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-a8742ce3-0b5a-4b74-b2d5-2dc695569ee8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:00.294755 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a8742ce3-0b5a-4b74-b2d5-2dc695569ee8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:00.295448 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a8742ce3-0b5a-4b74-b2d5-2dc695569ee8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:00.296979 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a8742ce3-0b5a-4b74-b2d5-2dc695569ee8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:00.298153 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a8742ce3-0b5a-4b74-b2d5-2dc695569ee8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:00.299249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a8742ce3-0b5a-4b74-b2d5-2dc695569ee8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:00.299834 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a8742ce3-0b5a-4b74-b2d5-2dc695569ee8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:00.503000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-a8742ce3-0b5a-4b74-b2d5-2dc695569ee8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:00.514567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-a8742ce3-0b5a-4b74-b2d5-2dc695569ee8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1546 microversion: 2.1 time: 0.233956 Aug 30 01:02:00.516658 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 74/139] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:00 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1546 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:00.538474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-dbcdda40-cb82-4926-8560-0f3b91f68fad tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:00.539562 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-dbcdda40-cb82-4926-8560-0f3b91f68fad tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:00.550958 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dbcdda40-cb82-4926-8560-0f3b91f68fad tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:00.552458 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dbcdda40-cb82-4926-8560-0f3b91f68fad tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:00.553340 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dbcdda40-cb82-4926-8560-0f3b91f68fad tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:00.555731 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8ed83a04-1140-443b-bddd-6de097b32657 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a00b1e41-b630-44fa-8fea-ebfbd18debf8"}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:00.555965 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dbcdda40-cb82-4926-8560-0f3b91f68fad tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:00.556714 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dbcdda40-cb82-4926-8560-0f3b91f68fad tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:00.557713 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dbcdda40-cb82-4926-8560-0f3b91f68fad tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:00.559219 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8ed83a04-1140-443b-bddd-6de097b32657 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:00.565891 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ed83a04-1140-443b-bddd-6de097b32657 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:00.566626 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ed83a04-1140-443b-bddd-6de097b32657 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:00.567237 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ed83a04-1140-443b-bddd-6de097b32657 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:00.568104 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ed83a04-1140-443b-bddd-6de097b32657 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:00.568940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ed83a04-1140-443b-bddd-6de097b32657 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:00.569588 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ed83a04-1140-443b-bddd-6de097b32657 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:00.758043 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-dbcdda40-cb82-4926-8560-0f3b91f68fad tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.224234 Aug 30 01:02:00.758876 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 66/140] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 30 01:02:00 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2/os-interface => generated 284 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:02:00.841161 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3d6794d8-b233-4550-ab48-9cf10669fda2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:00.843714 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-3d6794d8-b233-4550-ab48-9cf10669fda2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:00.853579 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3d6794d8-b233-4550-ab48-9cf10669fda2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:00.854662 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3d6794d8-b233-4550-ab48-9cf10669fda2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:00.855324 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3d6794d8-b233-4550-ab48-9cf10669fda2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:00.856345 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3d6794d8-b233-4550-ab48-9cf10669fda2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:00.868787 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3d6794d8-b233-4550-ab48-9cf10669fda2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:00.869564 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3d6794d8-b233-4550-ab48-9cf10669fda2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:01.205122 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3d6794d8-b233-4550-ab48-9cf10669fda2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:01.219582 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3d6794d8-b233-4550-ab48-9cf10669fda2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1366 microversion: 2.1 time: 0.382207 Aug 30 01:02:01.222552 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 67/141] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:00 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1366 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:01.237264 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-e4791d20-4445-4e10-9b36-d657819e7000 req-9bedb743-209d-4678-891a-83c64e6660eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d2ed1b9-2567-4964-83fd-dd44533766ae", "name": "network-vif-plugged", "status": "completed", "tag": "d7e5e765-e1c7-48ec-8dcf-1d5e6de0b12b"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:01.253019 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-e4791d20-4445-4e10-9b36-d657819e7000 req-9bedb743-209d-4678-891a-83c64e6660eb service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:01.256389 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-e4791d20-4445-4e10-9b36-d657819e7000 req-9bedb743-209d-4678-891a-83c64e6660eb service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:01.256943 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-e4791d20-4445-4e10-9b36-d657819e7000 req-9bedb743-209d-4678-891a-83c64e6660eb service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:01.283438 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-e4791d20-4445-4e10-9b36-d657819e7000 req-9bedb743-209d-4678-891a-83c64e6660eb service nova] Creating event network-vif-plugged:d7e5e765-e1c7-48ec-8dcf-1d5e6de0b12b for instance 8d2ed1b9-2567-4964-83fd-dd44533766ae on hv-cinder-81514 Aug 30 01:02:01.286366 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-e4791d20-4445-4e10-9b36-d657819e7000 req-9bedb743-209d-4678-891a-83c64e6660eb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062252 Aug 30 01:02:01.287655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 68/142] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:01.294511 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-41522f69-36e8-4b6c-870f-2c3a20902c49 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:01.296084 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-41522f69-36e8-4b6c-870f-2c3a20902c49 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:01.304166 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-41522f69-36e8-4b6c-870f-2c3a20902c49 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:01.305577 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-41522f69-36e8-4b6c-870f-2c3a20902c49 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:01.306381 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-41522f69-36e8-4b6c-870f-2c3a20902c49 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:01.307632 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-41522f69-36e8-4b6c-870f-2c3a20902c49 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:01.308321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-41522f69-36e8-4b6c-870f-2c3a20902c49 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:01.309064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-41522f69-36e8-4b6c-870f-2c3a20902c49 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:01.471335 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8ed83a04-1140-443b-bddd-6de097b32657 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "POST /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.919221 Aug 30 01:02:01.477055 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 75/143] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 30 01:02:00 2022] POST /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1/os-volume_attachments => generated 194 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:02:01.477215 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-41522f69-36e8-4b6c-870f-2c3a20902c49 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:01.485797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-e1cfd2f8-df64-4185-992a-743399e35ab0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:01.486502 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-e1cfd2f8-df64-4185-992a-743399e35ab0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:01.507814 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e1cfd2f8-df64-4185-992a-743399e35ab0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:01.508309 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e1cfd2f8-df64-4185-992a-743399e35ab0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:01.508746 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e1cfd2f8-df64-4185-992a-743399e35ab0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:01.509495 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e1cfd2f8-df64-4185-992a-743399e35ab0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:01.509952 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e1cfd2f8-df64-4185-992a-743399e35ab0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:01.510661 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e1cfd2f8-df64-4185-992a-743399e35ab0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:01.513622 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-41522f69-36e8-4b6c-870f-2c3a20902c49 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c" status: 200 len: 1264 microversion: 2.1 time: 0.192283 Aug 30 01:02:01.514278 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 69/144] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:01 2022] GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c => generated 1264 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:01.948227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-e1cfd2f8-df64-4185-992a-743399e35ab0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:01.960400 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-e1cfd2f8-df64-4185-992a-743399e35ab0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1322 microversion: 2.1 time: 0.487176 Aug 30 01:02:01.962037 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 76/145] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:01 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1322 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:02.242660 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e1dd545d-f343-431c-b50a-aea222e9a825 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:02.243290 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e1dd545d-f343-431c-b50a-aea222e9a825 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:02.251690 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e1dd545d-f343-431c-b50a-aea222e9a825 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:02.252247 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e1dd545d-f343-431c-b50a-aea222e9a825 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:02.252687 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e1dd545d-f343-431c-b50a-aea222e9a825 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:02.253648 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e1dd545d-f343-431c-b50a-aea222e9a825 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:02.254269 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e1dd545d-f343-431c-b50a-aea222e9a825 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:02.254700 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e1dd545d-f343-431c-b50a-aea222e9a825 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:02.537351 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-5d407607-7d70-47a3-b2f8-f7e45a7da33f tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:02.540436 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-5d407607-7d70-47a3-b2f8-f7e45a7da33f tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:02.563490 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5d407607-7d70-47a3-b2f8-f7e45a7da33f tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:02.572861 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5d407607-7d70-47a3-b2f8-f7e45a7da33f tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:02.575246 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5d407607-7d70-47a3-b2f8-f7e45a7da33f tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:02.575999 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5d407607-7d70-47a3-b2f8-f7e45a7da33f tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:02.576465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5d407607-7d70-47a3-b2f8-f7e45a7da33f tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:02.576903 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5d407607-7d70-47a3-b2f8-f7e45a7da33f tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:02.587732 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:02.793429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-5d407607-7d70-47a3-b2f8-f7e45a7da33f tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:02.809367 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-5d407607-7d70-47a3-b2f8-f7e45a7da33f tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c" status: 200 len: 1272 microversion: 2.1 time: 0.277145 Aug 30 01:02:02.810757 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 77/146] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:02 2022] GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c => generated 1272 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:02.996380 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4274265d-855c-4387-b628-5e4725d0c4fc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:02.996380 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-4274265d-855c-4387-b628-5e4725d0c4fc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:03.000089 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4274265d-855c-4387-b628-5e4725d0c4fc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:03.000669 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4274265d-855c-4387-b628-5e4725d0c4fc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:03.001321 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4274265d-855c-4387-b628-5e4725d0c4fc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:03.002118 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4274265d-855c-4387-b628-5e4725d0c4fc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:03.002824 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4274265d-855c-4387-b628-5e4725d0c4fc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:03.003796 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4274265d-855c-4387-b628-5e4725d0c4fc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:03.053447 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e1dd545d-f343-431c-b50a-aea222e9a825 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:03.063250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e1dd545d-f343-431c-b50a-aea222e9a825 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1366 microversion: 2.1 time: 0.826442 Aug 30 01:02:03.064029 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 70/147] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:02 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1366 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:03.368473 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-4274265d-855c-4387-b628-5e4725d0c4fc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:03.400531 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-4274265d-855c-4387-b628-5e4725d0c4fc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1515 microversion: 2.1 time: 0.413888 Aug 30 01:02:03.403446 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 78/148] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:02 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1515 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:03.426655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e2883595-da5c-4fbe-8fd5-a0c9d8f9e4f9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:03.433931 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e2883595-da5c-4fbe-8fd5-a0c9d8f9e4f9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:03.454670 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e2883595-da5c-4fbe-8fd5-a0c9d8f9e4f9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:03.457785 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e2883595-da5c-4fbe-8fd5-a0c9d8f9e4f9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:03.458704 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e2883595-da5c-4fbe-8fd5-a0c9d8f9e4f9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:03.459811 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e2883595-da5c-4fbe-8fd5-a0c9d8f9e4f9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:03.463349 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e2883595-da5c-4fbe-8fd5-a0c9d8f9e4f9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:03.464921 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e2883595-da5c-4fbe-8fd5-a0c9d8f9e4f9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:03.506363 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=100 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:03.526489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.objects.instance [None req-e2883595-da5c-4fbe-8fd5-a0c9d8f9e4f9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lazy-loading 'flavor' on Instance uuid 377d6898-d51c-4029-b9ce-3c96e2840dfd {{(pid=120631) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:02:03.777851 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-11e9fe6b-c31f-426b-8009-3619f11bc81d req-306c4db6-2c6d-42ad-9151-c24b94f6cbd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b59fedac-4fcb-47a8-8187-0a331d499fd2", "tag": "26facd73-81ff-4a35-9126-739f3f31881b"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:03.824733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-11e9fe6b-c31f-426b-8009-3619f11bc81d req-306c4db6-2c6d-42ad-9151-c24b94f6cbd9 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:03.832152 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-11e9fe6b-c31f-426b-8009-3619f11bc81d req-306c4db6-2c6d-42ad-9151-c24b94f6cbd9 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:03.832979 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-11e9fe6b-c31f-426b-8009-3619f11bc81d req-306c4db6-2c6d-42ad-9151-c24b94f6cbd9 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:03.871736 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e2883595-da5c-4fbe-8fd5-a0c9d8f9e4f9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "POST /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd/action" status: 200 len: 32 microversion: 2.1 time: 0.450044 Aug 30 01:02:03.877520 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 71/149] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 30 01:02:03 2022] POST /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd/action => generated 32 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:02:03.894264 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-abda226e-2b65-41dd-a8a8-6f25c37a371f tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:03.898130 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-abda226e-2b65-41dd-a8a8-6f25c37a371f tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:03.903082 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-11e9fe6b-c31f-426b-8009-3619f11bc81d req-306c4db6-2c6d-42ad-9151-c24b94f6cbd9 service nova] Creating event network-changed:26facd73-81ff-4a35-9126-739f3f31881b for instance b59fedac-4fcb-47a8-8187-0a331d499fd2 on hv-cinder-81514 Aug 30 01:02:03.916047 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-abda226e-2b65-41dd-a8a8-6f25c37a371f tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:03.923171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-abda226e-2b65-41dd-a8a8-6f25c37a371f tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:03.923171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-abda226e-2b65-41dd-a8a8-6f25c37a371f tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:03.925315 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-abda226e-2b65-41dd-a8a8-6f25c37a371f tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:03.925775 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-abda226e-2b65-41dd-a8a8-6f25c37a371f tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:03.925883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-11e9fe6b-c31f-426b-8009-3619f11bc81d req-306c4db6-2c6d-42ad-9151-c24b94f6cbd9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155332 Aug 30 01:02:03.926281 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-abda226e-2b65-41dd-a8a8-6f25c37a371f tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:03.926479 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 79/150] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:03.944349 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-ac345975-9d8d-480c-a531-802b3654bb6f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:03.945263 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-ac345975-9d8d-480c-a531-802b3654bb6f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:03.963409 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ac345975-9d8d-480c-a531-802b3654bb6f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:03.966307 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ac345975-9d8d-480c-a531-802b3654bb6f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:03.966804 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ac345975-9d8d-480c-a531-802b3654bb6f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:03.967542 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ac345975-9d8d-480c-a531-802b3654bb6f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:03.974259 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ac345975-9d8d-480c-a531-802b3654bb6f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:03.974929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ac345975-9d8d-480c-a531-802b3654bb6f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:04.326109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-abda226e-2b65-41dd-a8a8-6f25c37a371f tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:04.338283 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-abda226e-2b65-41dd-a8a8-6f25c37a371f tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c" status: 200 len: 1270 microversion: 2.1 time: 0.458776 Aug 30 01:02:04.339930 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 72/151] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:03 2022] GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c => generated 1270 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:04.347608 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-072ebbf5-c97b-4f1e-8465-3818228726d9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:04.348818 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-072ebbf5-c97b-4f1e-8465-3818228726d9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:04.353002 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:04.378670 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-072ebbf5-c97b-4f1e-8465-3818228726d9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:04.380546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-072ebbf5-c97b-4f1e-8465-3818228726d9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:04.381249 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-072ebbf5-c97b-4f1e-8465-3818228726d9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:04.383079 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-072ebbf5-c97b-4f1e-8465-3818228726d9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:04.386325 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-072ebbf5-c97b-4f1e-8465-3818228726d9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:04.390365 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-072ebbf5-c97b-4f1e-8465-3818228726d9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:04.553142 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-ac345975-9d8d-480c-a531-802b3654bb6f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:04.562678 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-ac345975-9d8d-480c-a531-802b3654bb6f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.634240 Aug 30 01:02:04.563432 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 80/152] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:03 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:04.791969 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-072ebbf5-c97b-4f1e-8465-3818228726d9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:04.804254 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-072ebbf5-c97b-4f1e-8465-3818228726d9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1366 microversion: 2.1 time: 0.461135 Aug 30 01:02:04.808466 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 73/153] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:04 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1366 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:05.365349 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f702428e-4ad0-4d04-8472-b713bdfdd588 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:05.366028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-f702428e-4ad0-4d04-8472-b713bdfdd588 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:05.375135 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f702428e-4ad0-4d04-8472-b713bdfdd588 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:05.375626 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f702428e-4ad0-4d04-8472-b713bdfdd588 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:05.376062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f702428e-4ad0-4d04-8472-b713bdfdd588 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:05.376757 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f702428e-4ad0-4d04-8472-b713bdfdd588 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:05.377402 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f702428e-4ad0-4d04-8472-b713bdfdd588 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:05.377981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f702428e-4ad0-4d04-8472-b713bdfdd588 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:05.585188 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e0daf2a2-34c6-437f-9cc3-bb8433cd6910 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:05.586353 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e0daf2a2-34c6-437f-9cc3-bb8433cd6910 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:05.594858 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e0daf2a2-34c6-437f-9cc3-bb8433cd6910 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:05.596865 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e0daf2a2-34c6-437f-9cc3-bb8433cd6910 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:05.598639 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e0daf2a2-34c6-437f-9cc3-bb8433cd6910 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:05.599534 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e0daf2a2-34c6-437f-9cc3-bb8433cd6910 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:05.601661 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e0daf2a2-34c6-437f-9cc3-bb8433cd6910 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:05.602289 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e0daf2a2-34c6-437f-9cc3-bb8433cd6910 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:05.985355 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-f702428e-4ad0-4d04-8472-b713bdfdd588 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:06.011538 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-f702428e-4ad0-4d04-8472-b713bdfdd588 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c" status: 200 len: 1312 microversion: 2.1 time: 0.650401 Aug 30 01:02:06.025311 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 81/154] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:05 2022] GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c => generated 1312 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:06.025311 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-770e1c25-49bd-43d0-b120-8ab2316e6797 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:06.025311 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-770e1c25-49bd-43d0-b120-8ab2316e6797 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:06.060031 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-770e1c25-49bd-43d0-b120-8ab2316e6797 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:06.060758 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-770e1c25-49bd-43d0-b120-8ab2316e6797 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:06.062170 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-770e1c25-49bd-43d0-b120-8ab2316e6797 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:06.063373 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-770e1c25-49bd-43d0-b120-8ab2316e6797 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:06.064016 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-770e1c25-49bd-43d0-b120-8ab2316e6797 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:06.064842 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-770e1c25-49bd-43d0-b120-8ab2316e6797 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:06.112478 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e0daf2a2-34c6-437f-9cc3-bb8433cd6910 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:06.120520 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e0daf2a2-34c6-437f-9cc3-bb8433cd6910 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.539240 Aug 30 01:02:06.125994 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 74/155] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:05 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:06.602151 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-770e1c25-49bd-43d0-b120-8ab2316e6797 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:06.611565 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-770e1c25-49bd-43d0-b120-8ab2316e6797 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1555 microversion: 2.1 time: 0.591725 Aug 30 01:02:06.612345 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 82/156] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:06 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1555 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:06.633424 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-fd5eeb32-da02-438b-b6ae-b35a511b8f76 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:06.633814 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-fd5eeb32-da02-438b-b6ae-b35a511b8f76 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:06.640663 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fd5eeb32-da02-438b-b6ae-b35a511b8f76 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:06.640969 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fd5eeb32-da02-438b-b6ae-b35a511b8f76 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:06.641440 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fd5eeb32-da02-438b-b6ae-b35a511b8f76 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:06.642147 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fd5eeb32-da02-438b-b6ae-b35a511b8f76 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:06.642782 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fd5eeb32-da02-438b-b6ae-b35a511b8f76 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:06.643326 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fd5eeb32-da02-438b-b6ae-b35a511b8f76 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:06.814277 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-fd5eeb32-da02-438b-b6ae-b35a511b8f76 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.183577 Aug 30 01:02:06.815175 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 75/157] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 30 01:02:06 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae/os-interface => generated 284 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:06.890910 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-d2e110aa-a5d0-45bf-b268-0d2b8a9b8512 req-8f9cf341-06f3-4cca-96e9-6b04aad6cb55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c", "tag": "d5901c41-4417-480b-839a-adeac6440d5f"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:06.917441 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-d2e110aa-a5d0-45bf-b268-0d2b8a9b8512 req-8f9cf341-06f3-4cca-96e9-6b04aad6cb55 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:06.918678 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-d2e110aa-a5d0-45bf-b268-0d2b8a9b8512 req-8f9cf341-06f3-4cca-96e9-6b04aad6cb55 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:06.919262 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-d2e110aa-a5d0-45bf-b268-0d2b8a9b8512 req-8f9cf341-06f3-4cca-96e9-6b04aad6cb55 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:06.936764 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-d2e110aa-a5d0-45bf-b268-0d2b8a9b8512 req-8f9cf341-06f3-4cca-96e9-6b04aad6cb55 service nova] Creating event network-changed:d5901c41-4417-480b-839a-adeac6440d5f for instance 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c on hv-cinder-81514 Aug 30 01:02:06.948318 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-d2e110aa-a5d0-45bf-b268-0d2b8a9b8512 req-8f9cf341-06f3-4cca-96e9-6b04aad6cb55 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060524 Aug 30 01:02:06.950711 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 83/158] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:07.048060 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-be07e322-be7e-4252-90c5-5faa25e615b8 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:07.048760 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-be07e322-be7e-4252-90c5-5faa25e615b8 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:07.055059 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-be07e322-be7e-4252-90c5-5faa25e615b8 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:07.055636 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-be07e322-be7e-4252-90c5-5faa25e615b8 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:07.056310 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-be07e322-be7e-4252-90c5-5faa25e615b8 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:07.057263 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-be07e322-be7e-4252-90c5-5faa25e615b8 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:07.057903 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-be07e322-be7e-4252-90c5-5faa25e615b8 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:07.058501 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-be07e322-be7e-4252-90c5-5faa25e615b8 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:07.155836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-3039b0b3-731e-42df-b9bd-b3d0212e8154 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:07.162164 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-3039b0b3-731e-42df-b9bd-b3d0212e8154 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:07.170561 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3039b0b3-731e-42df-b9bd-b3d0212e8154 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:07.172727 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3039b0b3-731e-42df-b9bd-b3d0212e8154 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:07.173695 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3039b0b3-731e-42df-b9bd-b3d0212e8154 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:07.177155 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3039b0b3-731e-42df-b9bd-b3d0212e8154 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:07.177933 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3039b0b3-731e-42df-b9bd-b3d0212e8154 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:07.178698 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3039b0b3-731e-42df-b9bd-b3d0212e8154 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:07.646211 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-3039b0b3-731e-42df-b9bd-b3d0212e8154 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:07.654492 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-be07e322-be7e-4252-90c5-5faa25e615b8 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:07.658079 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-3039b0b3-731e-42df-b9bd-b3d0212e8154 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.515167 Aug 30 01:02:07.659086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 84/159] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:07 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:07.662709 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-be07e322-be7e-4252-90c5-5faa25e615b8 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c" status: 200 len: 1312 microversion: 2.1 time: 0.618860 Aug 30 01:02:07.663281 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 76/160] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:07 2022] GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c => generated 1312 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:08.652230 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-919223ff-de73-4a78-98bc-14fa01ab76c0 req-b76eedfa-db40-4b4f-9054-641d254931d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d2ed1b9-2567-4964-83fd-dd44533766ae", "tag": "d7e5e765-e1c7-48ec-8dcf-1d5e6de0b12b"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:08.662804 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-919223ff-de73-4a78-98bc-14fa01ab76c0 req-b76eedfa-db40-4b4f-9054-641d254931d3 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:08.663782 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-919223ff-de73-4a78-98bc-14fa01ab76c0 req-b76eedfa-db40-4b4f-9054-641d254931d3 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:08.664287 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-919223ff-de73-4a78-98bc-14fa01ab76c0 req-b76eedfa-db40-4b4f-9054-641d254931d3 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:08.678508 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-919223ff-de73-4a78-98bc-14fa01ab76c0 req-b76eedfa-db40-4b4f-9054-641d254931d3 service nova] Creating event network-changed:d7e5e765-e1c7-48ec-8dcf-1d5e6de0b12b for instance 8d2ed1b9-2567-4964-83fd-dd44533766ae on hv-cinder-81514 Aug 30 01:02:08.685671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-919223ff-de73-4a78-98bc-14fa01ab76c0 req-b76eedfa-db40-4b4f-9054-641d254931d3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036879 Aug 30 01:02:08.685871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-5843742c-6bb5-40e5-957d-c9a4cce670a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:08.690889 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 85/161] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:08.692027 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-5843742c-6bb5-40e5-957d-c9a4cce670a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:08.697560 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-700c25d6-8819-441b-8e7d-3754fdb171cc tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:08.698500 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-700c25d6-8819-441b-8e7d-3754fdb171cc tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:08.699633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=2 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:08.702944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=6 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:08.708456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-700c25d6-8819-441b-8e7d-3754fdb171cc tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:08.709215 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-700c25d6-8819-441b-8e7d-3754fdb171cc tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:08.710534 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-700c25d6-8819-441b-8e7d-3754fdb171cc tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:08.711436 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-700c25d6-8819-441b-8e7d-3754fdb171cc tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:08.712634 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-700c25d6-8819-441b-8e7d-3754fdb171cc tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:08.712748 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5843742c-6bb5-40e5-957d-c9a4cce670a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:08.713289 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5843742c-6bb5-40e5-957d-c9a4cce670a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:08.715960 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5843742c-6bb5-40e5-957d-c9a4cce670a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:08.719489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5843742c-6bb5-40e5-957d-c9a4cce670a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:08.719720 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-700c25d6-8819-441b-8e7d-3754fdb171cc tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:08.721496 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5843742c-6bb5-40e5-957d-c9a4cce670a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:08.723098 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5843742c-6bb5-40e5-957d-c9a4cce670a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:08.960659 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-700c25d6-8819-441b-8e7d-3754fdb171cc tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:08.971596 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-700c25d6-8819-441b-8e7d-3754fdb171cc tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c" status: 200 len: 1312 microversion: 2.1 time: 0.278983 Aug 30 01:02:08.973324 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 86/162] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:08 2022] GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c => generated 1312 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:08.993724 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-5843742c-6bb5-40e5-957d-c9a4cce670a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:09.003752 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-5843742c-6bb5-40e5-957d-c9a4cce670a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.327364 Aug 30 01:02:09.004379 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 77/163] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:08 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:09.998111 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-c2cb4393-9ec3-430a-bcbc-876786747374 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:10.000055 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-c2cb4393-9ec3-430a-bcbc-876786747374 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:10.006677 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=2 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:10.009739 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c2cb4393-9ec3-430a-bcbc-876786747374 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:10.010507 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c2cb4393-9ec3-430a-bcbc-876786747374 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:10.011004 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c2cb4393-9ec3-430a-bcbc-876786747374 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:10.011764 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c2cb4393-9ec3-430a-bcbc-876786747374 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:10.012212 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c2cb4393-9ec3-430a-bcbc-876786747374 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:10.012661 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c2cb4393-9ec3-430a-bcbc-876786747374 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:10.025251 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-906a5f27-2016-453d-8a4e-85073442b3d8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:10.026462 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-906a5f27-2016-453d-8a4e-85073442b3d8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:10.052822 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-906a5f27-2016-453d-8a4e-85073442b3d8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:10.053786 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-906a5f27-2016-453d-8a4e-85073442b3d8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:10.054587 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-906a5f27-2016-453d-8a4e-85073442b3d8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:10.055381 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-906a5f27-2016-453d-8a4e-85073442b3d8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:10.055871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-906a5f27-2016-453d-8a4e-85073442b3d8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:10.056304 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-906a5f27-2016-453d-8a4e-85073442b3d8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:10.356079 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-c2cb4393-9ec3-430a-bcbc-876786747374 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:10.370691 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-c2cb4393-9ec3-430a-bcbc-876786747374 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c" status: 200 len: 1312 microversion: 2.1 time: 0.379423 Aug 30 01:02:10.390129 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 87/164] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:09 2022] GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c => generated 1312 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:10.400794 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-906a5f27-2016-453d-8a4e-85073442b3d8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:10.412029 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-906a5f27-2016-453d-8a4e-85073442b3d8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.389666 Aug 30 01:02:10.412029 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 78/165] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:10 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:11.393599 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-cc450f42-dd96-47e1-b760-fc8c86d5432a tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:11.394222 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-cc450f42-dd96-47e1-b760-fc8c86d5432a tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:11.397917 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=92 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:11.401956 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cc450f42-dd96-47e1-b760-fc8c86d5432a tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:11.402505 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cc450f42-dd96-47e1-b760-fc8c86d5432a tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:11.403282 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cc450f42-dd96-47e1-b760-fc8c86d5432a tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:11.403972 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cc450f42-dd96-47e1-b760-fc8c86d5432a tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:11.404634 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cc450f42-dd96-47e1-b760-fc8c86d5432a tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:11.405101 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cc450f42-dd96-47e1-b760-fc8c86d5432a tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:11.434336 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-a1951dda-5dc8-4f34-a5fa-dc0cdbe5e048 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:11.437313 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-a1951dda-5dc8-4f34-a5fa-dc0cdbe5e048 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:11.476239 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a1951dda-5dc8-4f34-a5fa-dc0cdbe5e048 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:11.477406 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a1951dda-5dc8-4f34-a5fa-dc0cdbe5e048 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:11.478077 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a1951dda-5dc8-4f34-a5fa-dc0cdbe5e048 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:11.478986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a1951dda-5dc8-4f34-a5fa-dc0cdbe5e048 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:11.479891 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a1951dda-5dc8-4f34-a5fa-dc0cdbe5e048 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:11.481328 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a1951dda-5dc8-4f34-a5fa-dc0cdbe5e048 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:11.634509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-cc450f42-dd96-47e1-b760-fc8c86d5432a tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:11.644542 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-cc450f42-dd96-47e1-b760-fc8c86d5432a tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c" status: 200 len: 1312 microversion: 2.1 time: 0.256571 Aug 30 01:02:11.646972 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 88/166] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:11 2022] GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c => generated 1312 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:11.696036 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-a1951dda-5dc8-4f34-a5fa-dc0cdbe5e048 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:11.705439 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-a1951dda-5dc8-4f34-a5fa-dc0cdbe5e048 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.276823 Aug 30 01:02:11.706374 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 79/167] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:11 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:12.517532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-a6bcf003-88dc-42d9-983c-9ba55bcef2f1 req-497ab8e0-98e5-4cc4-b37d-9458a11e81b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c", "name": "network-vif-plugged", "status": "completed", "tag": "d5901c41-4417-480b-839a-adeac6440d5f"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:12.536573 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-a6bcf003-88dc-42d9-983c-9ba55bcef2f1 req-497ab8e0-98e5-4cc4-b37d-9458a11e81b3 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:12.537481 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-a6bcf003-88dc-42d9-983c-9ba55bcef2f1 req-497ab8e0-98e5-4cc4-b37d-9458a11e81b3 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:12.539043 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-a6bcf003-88dc-42d9-983c-9ba55bcef2f1 req-497ab8e0-98e5-4cc4-b37d-9458a11e81b3 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:12.562007 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-a6bcf003-88dc-42d9-983c-9ba55bcef2f1 req-497ab8e0-98e5-4cc4-b37d-9458a11e81b3 service nova] Creating event network-vif-plugged:d5901c41-4417-480b-839a-adeac6440d5f for instance 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c on hv-cinder-81514 Aug 30 01:02:12.574720 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-a6bcf003-88dc-42d9-983c-9ba55bcef2f1 req-497ab8e0-98e5-4cc4-b37d-9458a11e81b3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061829 Aug 30 01:02:12.575333 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 89/168] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:12.672185 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-5d71706d-2f7b-48ac-826e-ac1d2c395cf2 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:12.672891 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-5d71706d-2f7b-48ac-826e-ac1d2c395cf2 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:12.687872 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5d71706d-2f7b-48ac-826e-ac1d2c395cf2 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:12.689382 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5d71706d-2f7b-48ac-826e-ac1d2c395cf2 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:12.690008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5d71706d-2f7b-48ac-826e-ac1d2c395cf2 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:12.692644 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5d71706d-2f7b-48ac-826e-ac1d2c395cf2 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:12.694205 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5d71706d-2f7b-48ac-826e-ac1d2c395cf2 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:12.695926 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5d71706d-2f7b-48ac-826e-ac1d2c395cf2 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:12.731419 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-dfdcbb67-4767-4356-9c94-8dfef73d0b73 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:12.732361 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-dfdcbb67-4767-4356-9c94-8dfef73d0b73 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:12.759049 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dfdcbb67-4767-4356-9c94-8dfef73d0b73 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:12.759636 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dfdcbb67-4767-4356-9c94-8dfef73d0b73 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:12.760086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dfdcbb67-4767-4356-9c94-8dfef73d0b73 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:12.760810 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dfdcbb67-4767-4356-9c94-8dfef73d0b73 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:12.761569 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dfdcbb67-4767-4356-9c94-8dfef73d0b73 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:12.761710 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dfdcbb67-4767-4356-9c94-8dfef73d0b73 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:13.156241 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-5d71706d-2f7b-48ac-826e-ac1d2c395cf2 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:13.177214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-5d71706d-2f7b-48ac-826e-ac1d2c395cf2 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c" status: 200 len: 1312 microversion: 2.1 time: 0.509684 Aug 30 01:02:13.178154 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 80/169] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:12 2022] GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c => generated 1312 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:13.183439 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-70f508d7-2a3d-47f4-93b3-dcb35edfcb7a tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:13.189734 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-70f508d7-2a3d-47f4-93b3-dcb35edfcb7a tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:13.208195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-70f508d7-2a3d-47f4-93b3-dcb35edfcb7a tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:13.208724 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-70f508d7-2a3d-47f4-93b3-dcb35edfcb7a tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:13.209218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-dfdcbb67-4767-4356-9c94-8dfef73d0b73 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:13.209340 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-70f508d7-2a3d-47f4-93b3-dcb35edfcb7a tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:13.210354 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-70f508d7-2a3d-47f4-93b3-dcb35edfcb7a tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:13.210806 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-70f508d7-2a3d-47f4-93b3-dcb35edfcb7a tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:13.211230 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-70f508d7-2a3d-47f4-93b3-dcb35edfcb7a tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:13.220392 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-dfdcbb67-4767-4356-9c94-8dfef73d0b73 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.496716 Aug 30 01:02:13.221331 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 90/170] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:12 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:13.251840 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-70f508d7-2a3d-47f4-93b3-dcb35edfcb7a tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Going to try to terminate instance {{(pid=120631) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:02:13.400732 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-70f508d7-2a3d-47f4-93b3-dcb35edfcb7a tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "DELETE /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 204 len: 0 microversion: 2.1 time: 0.220396 Aug 30 01:02:13.402659 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 81/171] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:02:13 2022] DELETE /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:02:13.412050 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-7c899543-5546-4447-8622-3321ec49f7f8 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:13.413033 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-7c899543-5546-4447-8622-3321ec49f7f8 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:13.419189 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c899543-5546-4447-8622-3321ec49f7f8 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:13.421163 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c899543-5546-4447-8622-3321ec49f7f8 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:13.421775 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c899543-5546-4447-8622-3321ec49f7f8 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:13.423014 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c899543-5546-4447-8622-3321ec49f7f8 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:13.423637 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c899543-5546-4447-8622-3321ec49f7f8 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:13.424213 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c899543-5546-4447-8622-3321ec49f7f8 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:13.618701 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7c899543-5546-4447-8622-3321ec49f7f8 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:13.627591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-7c899543-5546-4447-8622-3321ec49f7f8 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1552 microversion: 2.1 time: 0.220174 Aug 30 01:02:13.629321 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 91/172] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:13 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1552 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:14.199823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-29b5f1c3-e409-40c9-91e7-5c3f22bfbbda tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:14.200518 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-29b5f1c3-e409-40c9-91e7-5c3f22bfbbda tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:14.207194 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-29b5f1c3-e409-40c9-91e7-5c3f22bfbbda tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:14.207676 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-29b5f1c3-e409-40c9-91e7-5c3f22bfbbda tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:14.208102 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-29b5f1c3-e409-40c9-91e7-5c3f22bfbbda tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:14.208788 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-29b5f1c3-e409-40c9-91e7-5c3f22bfbbda tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:14.209437 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-29b5f1c3-e409-40c9-91e7-5c3f22bfbbda tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:14.209858 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-29b5f1c3-e409-40c9-91e7-5c3f22bfbbda tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:14.241727 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8e1be28a-64b7-4d42-9195-daede48d32d8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:14.242330 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8e1be28a-64b7-4d42-9195-daede48d32d8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:14.249489 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8e1be28a-64b7-4d42-9195-daede48d32d8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:14.249973 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8e1be28a-64b7-4d42-9195-daede48d32d8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:14.251395 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8e1be28a-64b7-4d42-9195-daede48d32d8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:14.266083 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8e1be28a-64b7-4d42-9195-daede48d32d8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:14.266711 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8e1be28a-64b7-4d42-9195-daede48d32d8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:14.267374 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8e1be28a-64b7-4d42-9195-daede48d32d8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:14.473526 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-29b5f1c3-e409-40c9-91e7-5c3f22bfbbda tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:14.478558 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8e1be28a-64b7-4d42-9195-daede48d32d8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:14.486357 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-29b5f1c3-e409-40c9-91e7-5c3f22bfbbda tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c" status: 200 len: 1312 microversion: 2.1 time: 0.291162 Aug 30 01:02:14.487800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8e1be28a-64b7-4d42-9195-daede48d32d8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.249722 Aug 30 01:02:14.487994 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 82/173] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:14 2022] GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c => generated 1312 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:14.488676 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 92/174] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:14 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:14.650070 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-19d8bac5-ed93-4479-a8c1-a0a0ca6ffd22 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:14.650685 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-19d8bac5-ed93-4479-a8c1-a0a0ca6ffd22 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:14.656602 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-19d8bac5-ed93-4479-a8c1-a0a0ca6ffd22 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:14.657232 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-19d8bac5-ed93-4479-a8c1-a0a0ca6ffd22 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:14.657547 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-19d8bac5-ed93-4479-a8c1-a0a0ca6ffd22 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:14.658248 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-19d8bac5-ed93-4479-a8c1-a0a0ca6ffd22 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:14.658705 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-19d8bac5-ed93-4479-a8c1-a0a0ca6ffd22 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:14.659128 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-19d8bac5-ed93-4479-a8c1-a0a0ca6ffd22 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:14.815546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-19d8bac5-ed93-4479-a8c1-a0a0ca6ffd22 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:14.824949 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-19d8bac5-ed93-4479-a8c1-a0a0ca6ffd22 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1552 microversion: 2.1 time: 0.178646 Aug 30 01:02:14.825665 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 83/175] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:14 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1552 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:15.518375 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0b69069c-cd28-44e6-805b-bbb809283337 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:15.519019 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-0b69069c-cd28-44e6-805b-bbb809283337 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:15.519405 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-39b6658e-3989-40dd-af13-99ac0e261fe6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:15.520665 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-39b6658e-3989-40dd-af13-99ac0e261fe6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:15.526966 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-39b6658e-3989-40dd-af13-99ac0e261fe6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:15.531241 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-39b6658e-3989-40dd-af13-99ac0e261fe6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:15.534643 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-39b6658e-3989-40dd-af13-99ac0e261fe6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:15.535409 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b69069c-cd28-44e6-805b-bbb809283337 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:15.536288 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-39b6658e-3989-40dd-af13-99ac0e261fe6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:15.536881 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b69069c-cd28-44e6-805b-bbb809283337 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:15.537449 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-39b6658e-3989-40dd-af13-99ac0e261fe6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:15.537872 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-39b6658e-3989-40dd-af13-99ac0e261fe6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:15.538429 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b69069c-cd28-44e6-805b-bbb809283337 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:15.539883 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b69069c-cd28-44e6-805b-bbb809283337 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:15.541845 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b69069c-cd28-44e6-805b-bbb809283337 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:15.542391 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b69069c-cd28-44e6-805b-bbb809283337 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:15.793127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-39b6658e-3989-40dd-af13-99ac0e261fe6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:15.797173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-0b69069c-cd28-44e6-805b-bbb809283337 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:15.801376 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-39b6658e-3989-40dd-af13-99ac0e261fe6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c" status: 200 len: 1312 microversion: 2.1 time: 0.291396 Aug 30 01:02:15.801710 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:15.801951 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 93/176] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:15 2022] GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c => generated 1312 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:15.810545 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0b69069c-cd28-44e6-805b-bbb809283337 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.301871 Aug 30 01:02:15.826264 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 84/177] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:15 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:15.849326 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-97be2fbb-a246-4bd5-ae32-ea3df6685175 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:15.850044 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-97be2fbb-a246-4bd5-ae32-ea3df6685175 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:15.863989 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-97be2fbb-a246-4bd5-ae32-ea3df6685175 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:15.865196 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-97be2fbb-a246-4bd5-ae32-ea3df6685175 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:15.866225 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-97be2fbb-a246-4bd5-ae32-ea3df6685175 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:15.867558 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-97be2fbb-a246-4bd5-ae32-ea3df6685175 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:15.868434 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-97be2fbb-a246-4bd5-ae32-ea3df6685175 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:15.869206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-97be2fbb-a246-4bd5-ae32-ea3df6685175 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:16.039094 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-97be2fbb-a246-4bd5-ae32-ea3df6685175 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:16.050733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-97be2fbb-a246-4bd5-ae32-ea3df6685175 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1552 microversion: 2.1 time: 0.208118 Aug 30 01:02:16.057612 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 94/178] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:15 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1552 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:16.823292 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-a0cd64b4-f04e-4be9-9361-75f70332a613 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:16.824047 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-a0cd64b4-f04e-4be9-9361-75f70332a613 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:16.832774 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a0cd64b4-f04e-4be9-9361-75f70332a613 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:16.833600 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a0cd64b4-f04e-4be9-9361-75f70332a613 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:16.834112 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a0cd64b4-f04e-4be9-9361-75f70332a613 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:16.834886 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a0cd64b4-f04e-4be9-9361-75f70332a613 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:16.835409 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a0cd64b4-f04e-4be9-9361-75f70332a613 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:16.835906 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a0cd64b4-f04e-4be9-9361-75f70332a613 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:16.836942 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-bc427049-2a57-42d6-8385-0a1eb32355ee tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:16.837774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-bc427049-2a57-42d6-8385-0a1eb32355ee tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:16.844253 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bc427049-2a57-42d6-8385-0a1eb32355ee tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:16.844734 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bc427049-2a57-42d6-8385-0a1eb32355ee tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:16.845205 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bc427049-2a57-42d6-8385-0a1eb32355ee tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:16.845898 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bc427049-2a57-42d6-8385-0a1eb32355ee tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:16.846519 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bc427049-2a57-42d6-8385-0a1eb32355ee tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:16.847062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bc427049-2a57-42d6-8385-0a1eb32355ee tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:17.065235 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-bc427049-2a57-42d6-8385-0a1eb32355ee tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:17.066435 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-a0cd64b4-f04e-4be9-9361-75f70332a613 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:17.075736 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-a0cd64b4-f04e-4be9-9361-75f70332a613 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c" status: 200 len: 1312 microversion: 2.1 time: 0.257280 Aug 30 01:02:17.076527 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 85/179] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:16 2022] GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c => generated 1312 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:17.077331 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-bc427049-2a57-42d6-8385-0a1eb32355ee tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.244137 Aug 30 01:02:17.078419 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 95/180] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:16 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:17.094287 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-d2c5b087-17de-4108-84d5-f2e65444d2a4 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:17.094981 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-d2c5b087-17de-4108-84d5-f2e65444d2a4 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:17.102897 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d2c5b087-17de-4108-84d5-f2e65444d2a4 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:17.102897 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d2c5b087-17de-4108-84d5-f2e65444d2a4 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:17.102897 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d2c5b087-17de-4108-84d5-f2e65444d2a4 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:17.103731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d2c5b087-17de-4108-84d5-f2e65444d2a4 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:17.104257 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d2c5b087-17de-4108-84d5-f2e65444d2a4 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:17.104755 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d2c5b087-17de-4108-84d5-f2e65444d2a4 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:17.507030 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-d2c5b087-17de-4108-84d5-f2e65444d2a4 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:17.516014 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-d2c5b087-17de-4108-84d5-f2e65444d2a4 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1552 microversion: 2.1 time: 0.426064 Aug 30 01:02:17.516903 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 86/181] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:17 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1552 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:18.096053 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-e805395b-fc13-4afd-a10b-8787d66f4947 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:18.096670 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-e805395b-fc13-4afd-a10b-8787d66f4947 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:18.099012 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e8fc1d02-f19e-4b22-8f21-a72537f2123c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:18.099631 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e8fc1d02-f19e-4b22-8f21-a72537f2123c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:18.104892 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e805395b-fc13-4afd-a10b-8787d66f4947 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:18.105555 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e805395b-fc13-4afd-a10b-8787d66f4947 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:18.105855 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e805395b-fc13-4afd-a10b-8787d66f4947 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:18.106564 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e805395b-fc13-4afd-a10b-8787d66f4947 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:18.107063 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e805395b-fc13-4afd-a10b-8787d66f4947 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:18.107435 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e805395b-fc13-4afd-a10b-8787d66f4947 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:18.112981 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e8fc1d02-f19e-4b22-8f21-a72537f2123c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:18.113675 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e8fc1d02-f19e-4b22-8f21-a72537f2123c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:18.114258 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e8fc1d02-f19e-4b22-8f21-a72537f2123c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:18.114960 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e8fc1d02-f19e-4b22-8f21-a72537f2123c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:18.115559 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e8fc1d02-f19e-4b22-8f21-a72537f2123c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:18.115983 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e8fc1d02-f19e-4b22-8f21-a72537f2123c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:18.151465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=100 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:18.622033 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e8fc1d02-f19e-4b22-8f21-a72537f2123c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:18.638443 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e8fc1d02-f19e-4b22-8f21-a72537f2123c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.544130 Aug 30 01:02:18.640046 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 87/182] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:18 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:18.644828 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-6ae974f3-cbfa-4333-a7b5-2449740fa7fd tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:18.649548 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-6ae974f3-cbfa-4333-a7b5-2449740fa7fd tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:18.659609 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ae974f3-cbfa-4333-a7b5-2449740fa7fd tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:18.660133 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ae974f3-cbfa-4333-a7b5-2449740fa7fd tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:18.660563 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ae974f3-cbfa-4333-a7b5-2449740fa7fd tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:18.661400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ae974f3-cbfa-4333-a7b5-2449740fa7fd tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:18.661910 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ae974f3-cbfa-4333-a7b5-2449740fa7fd tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:18.662587 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ae974f3-cbfa-4333-a7b5-2449740fa7fd tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:18.690974 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-e805395b-fc13-4afd-a10b-8787d66f4947 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:18.701846 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-e805395b-fc13-4afd-a10b-8787d66f4947 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c" status: 200 len: 1497 microversion: 2.1 time: 0.609912 Aug 30 01:02:18.702807 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 96/183] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:18 2022] GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c => generated 1497 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:18.811491 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-f68bd28f-bb5a-47cc-a6e1-6782f0c1c28b req-6101dc2f-b966-4c45-820a-3e2c458dde61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "463f5c61-231b-435d-b0ec-440e941d8ae1", "name": "network-vif-deleted", "tag": "5eb7c376-7d0c-4333-90b3-56b8d45e7089"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:18.829753 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-f68bd28f-bb5a-47cc-a6e1-6782f0c1c28b req-6101dc2f-b966-4c45-820a-3e2c458dde61 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:18.831693 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-f68bd28f-bb5a-47cc-a6e1-6782f0c1c28b req-6101dc2f-b966-4c45-820a-3e2c458dde61 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:18.832211 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-f68bd28f-bb5a-47cc-a6e1-6782f0c1c28b req-6101dc2f-b966-4c45-820a-3e2c458dde61 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:18.843682 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6ae974f3-cbfa-4333-a7b5-2449740fa7fd tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:18.850935 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-f68bd28f-bb5a-47cc-a6e1-6782f0c1c28b req-6101dc2f-b966-4c45-820a-3e2c458dde61 service nova] Creating event network-vif-deleted:5eb7c376-7d0c-4333-90b3-56b8d45e7089 for instance 463f5c61-231b-435d-b0ec-440e941d8ae1 on hv-cinder-81514 Aug 30 01:02:18.856668 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-f68bd28f-bb5a-47cc-a6e1-6782f0c1c28b req-6101dc2f-b966-4c45-820a-3e2c458dde61 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051801 Aug 30 01:02:18.857450 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 97/184] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:18.859389 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-6ae974f3-cbfa-4333-a7b5-2449740fa7fd tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1510 microversion: 2.1 time: 0.217847 Aug 30 01:02:18.859962 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 88/185] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:18 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1510 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:19.580110 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-25d9c830-5b5e-4181-a4fb-57d244ebdb36 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:19.580685 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-25d9c830-5b5e-4181-a4fb-57d244ebdb36 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:19.587224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-25d9c830-5b5e-4181-a4fb-57d244ebdb36 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:19.587943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-25d9c830-5b5e-4181-a4fb-57d244ebdb36 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:19.588548 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-25d9c830-5b5e-4181-a4fb-57d244ebdb36 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:19.589535 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-25d9c830-5b5e-4181-a4fb-57d244ebdb36 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:19.590728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-25d9c830-5b5e-4181-a4fb-57d244ebdb36 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:19.591456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-25d9c830-5b5e-4181-a4fb-57d244ebdb36 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:19.622681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-25d9c830-5b5e-4181-a4fb-57d244ebdb36 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c] Going to try to terminate instance {{(pid=120630) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:02:19.661113 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-625a686b-ba62-44e5-8496-2e26a3dbb13e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:19.662428 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-625a686b-ba62-44e5-8496-2e26a3dbb13e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:19.670101 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-625a686b-ba62-44e5-8496-2e26a3dbb13e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:19.671076 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-625a686b-ba62-44e5-8496-2e26a3dbb13e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:19.671884 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-625a686b-ba62-44e5-8496-2e26a3dbb13e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:19.672958 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-625a686b-ba62-44e5-8496-2e26a3dbb13e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:19.673884 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-625a686b-ba62-44e5-8496-2e26a3dbb13e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:19.674616 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-625a686b-ba62-44e5-8496-2e26a3dbb13e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:19.765504 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-25d9c830-5b5e-4181-a4fb-57d244ebdb36 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c" status: 204 len: 0 microversion: 2.1 time: 0.189404 Aug 30 01:02:19.766577 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 98/186] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:02:19 2022] DELETE /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:02:19.775613 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-fdb254d7-69e6-4290-9566-977329d54543 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:19.776452 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-fdb254d7-69e6-4290-9566-977329d54543 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:19.784004 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fdb254d7-69e6-4290-9566-977329d54543 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:19.784895 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fdb254d7-69e6-4290-9566-977329d54543 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:19.785597 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fdb254d7-69e6-4290-9566-977329d54543 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:19.786565 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fdb254d7-69e6-4290-9566-977329d54543 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:19.787263 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fdb254d7-69e6-4290-9566-977329d54543 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:19.787887 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fdb254d7-69e6-4290-9566-977329d54543 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:19.973591 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-625a686b-ba62-44e5-8496-2e26a3dbb13e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:19.981152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-625a686b-ba62-44e5-8496-2e26a3dbb13e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.324597 Aug 30 01:02:19.981746 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 89/187] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:19 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:19.986919 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0b13cb5f-0512-4df4-b8fa-1352cc104a65 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:19.987526 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-0b13cb5f-0512-4df4-b8fa-1352cc104a65 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:19.993340 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b13cb5f-0512-4df4-b8fa-1352cc104a65 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:19.993839 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b13cb5f-0512-4df4-b8fa-1352cc104a65 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:19.994261 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b13cb5f-0512-4df4-b8fa-1352cc104a65 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:19.994959 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b13cb5f-0512-4df4-b8fa-1352cc104a65 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:19.995412 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b13cb5f-0512-4df4-b8fa-1352cc104a65 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:19.995833 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b13cb5f-0512-4df4-b8fa-1352cc104a65 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:20.029634 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b13cb5f-0512-4df4-b8fa-1352cc104a65 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:20.030293 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b13cb5f-0512-4df4-b8fa-1352cc104a65 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:20.030838 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b13cb5f-0512-4df4-b8fa-1352cc104a65 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:20.031170 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.objects.instance [None req-0b13cb5f-0512-4df4-b8fa-1352cc104a65 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lazy-loading 'fault' on Instance uuid 463f5c61-231b-435d-b0ec-440e941d8ae1 {{(pid=120631) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:02:20.032667 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-fdb254d7-69e6-4290-9566-977329d54543 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:20.040849 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-fdb254d7-69e6-4290-9566-977329d54543 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c" status: 200 len: 1503 microversion: 2.1 time: 0.269691 Aug 30 01:02:20.042033 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 99/188] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:19 2022] GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c => generated 1503 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:20.093068 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-0b13cb5f-0512-4df4-b8fa-1352cc104a65 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:20.105690 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0b13cb5f-0512-4df4-b8fa-1352cc104a65 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1349 microversion: 2.1 time: 0.122826 Aug 30 01:02:20.106288 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 90/189] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:19 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1349 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:21.004322 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-43a3e10b-eb37-49af-9d28-c4d2ff072b78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:21.004830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-43a3e10b-eb37-49af-9d28-c4d2ff072b78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:21.011185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-43a3e10b-eb37-49af-9d28-c4d2ff072b78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:21.011663 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-43a3e10b-eb37-49af-9d28-c4d2ff072b78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:21.012098 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-43a3e10b-eb37-49af-9d28-c4d2ff072b78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:21.012779 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-43a3e10b-eb37-49af-9d28-c4d2ff072b78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:21.013266 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-43a3e10b-eb37-49af-9d28-c4d2ff072b78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:21.014181 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-43a3e10b-eb37-49af-9d28-c4d2ff072b78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:21.063604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e404198d-9636-47ce-8acd-b6d6da2cbd05 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:21.064219 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e404198d-9636-47ce-8acd-b6d6da2cbd05 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:21.070492 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e404198d-9636-47ce-8acd-b6d6da2cbd05 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:21.071013 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e404198d-9636-47ce-8acd-b6d6da2cbd05 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:21.071594 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e404198d-9636-47ce-8acd-b6d6da2cbd05 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:21.072729 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e404198d-9636-47ce-8acd-b6d6da2cbd05 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:21.073279 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e404198d-9636-47ce-8acd-b6d6da2cbd05 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:21.073774 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e404198d-9636-47ce-8acd-b6d6da2cbd05 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:21.209653 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-43a3e10b-eb37-49af-9d28-c4d2ff072b78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:21.217803 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-43a3e10b-eb37-49af-9d28-c4d2ff072b78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.216736 Aug 30 01:02:21.218413 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 100/190] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:20 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:21.222937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-a947ede9-84e8-41dd-bb3b-c6350ee251c0 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:21.223539 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-a947ede9-84e8-41dd-bb3b-c6350ee251c0 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:21.229305 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a947ede9-84e8-41dd-bb3b-c6350ee251c0 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:21.229793 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a947ede9-84e8-41dd-bb3b-c6350ee251c0 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:21.230227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a947ede9-84e8-41dd-bb3b-c6350ee251c0 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:21.230911 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a947ede9-84e8-41dd-bb3b-c6350ee251c0 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:21.231361 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a947ede9-84e8-41dd-bb3b-c6350ee251c0 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:21.231781 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a947ede9-84e8-41dd-bb3b-c6350ee251c0 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:21.250117 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e404198d-9636-47ce-8acd-b6d6da2cbd05 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:21.258097 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e404198d-9636-47ce-8acd-b6d6da2cbd05 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c" status: 200 len: 1503 microversion: 2.1 time: 0.198933 Aug 30 01:02:21.258861 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 91/191] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:21 2022] GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c => generated 1503 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:21.274231 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a947ede9-84e8-41dd-bb3b-c6350ee251c0 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:21.274744 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a947ede9-84e8-41dd-bb3b-c6350ee251c0 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:21.275204 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a947ede9-84e8-41dd-bb3b-c6350ee251c0 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:21.275664 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.objects.instance [None req-a947ede9-84e8-41dd-bb3b-c6350ee251c0 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lazy-loading 'fault' on Instance uuid 463f5c61-231b-435d-b0ec-440e941d8ae1 {{(pid=120630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:02:21.320233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-a947ede9-84e8-41dd-bb3b-c6350ee251c0 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:21.329347 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-a947ede9-84e8-41dd-bb3b-c6350ee251c0 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1349 microversion: 2.1 time: 0.109882 Aug 30 01:02:21.329924 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 101/192] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:21 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1349 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:22.238700 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-dec3c7b1-6da5-4fc5-a40b-ae9736d6c000 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:22.239324 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-dec3c7b1-6da5-4fc5-a40b-ae9736d6c000 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:22.245677 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dec3c7b1-6da5-4fc5-a40b-ae9736d6c000 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:22.246170 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dec3c7b1-6da5-4fc5-a40b-ae9736d6c000 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:22.246607 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dec3c7b1-6da5-4fc5-a40b-ae9736d6c000 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:22.247320 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dec3c7b1-6da5-4fc5-a40b-ae9736d6c000 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:22.247937 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dec3c7b1-6da5-4fc5-a40b-ae9736d6c000 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:22.249499 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dec3c7b1-6da5-4fc5-a40b-ae9736d6c000 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:22.281833 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-7d245673-3944-4758-a729-99988d572ddf tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:22.282457 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-7d245673-3944-4758-a729-99988d572ddf tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:22.292222 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7d245673-3944-4758-a729-99988d572ddf tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:22.292707 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7d245673-3944-4758-a729-99988d572ddf tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:22.293252 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7d245673-3944-4758-a729-99988d572ddf tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:22.293988 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7d245673-3944-4758-a729-99988d572ddf tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:22.294445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7d245673-3944-4758-a729-99988d572ddf tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:22.295192 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7d245673-3944-4758-a729-99988d572ddf tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:22.547866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-dec3c7b1-6da5-4fc5-a40b-ae9736d6c000 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:22.555380 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7d245673-3944-4758-a729-99988d572ddf tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:22.561718 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-dec3c7b1-6da5-4fc5-a40b-ae9736d6c000 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.324109 Aug 30 01:02:22.562236 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 92/193] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:22 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:22.578297 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-7d245673-3944-4758-a729-99988d572ddf tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c" status: 200 len: 1503 microversion: 2.1 time: 0.300932 Aug 30 01:02:22.582180 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-6ab2cb7d-e556-4161-8585-98dcd6301f5f tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:22.582864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-6ab2cb7d-e556-4161-8585-98dcd6301f5f tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:22.586614 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 102/194] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:22 2022] GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c => generated 1503 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:22.610707 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ab2cb7d-e556-4161-8585-98dcd6301f5f tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:22.611264 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ab2cb7d-e556-4161-8585-98dcd6301f5f tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:22.611704 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ab2cb7d-e556-4161-8585-98dcd6301f5f tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:22.613019 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ab2cb7d-e556-4161-8585-98dcd6301f5f tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:22.613584 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ab2cb7d-e556-4161-8585-98dcd6301f5f tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:22.614012 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ab2cb7d-e556-4161-8585-98dcd6301f5f tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:22.652856 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ab2cb7d-e556-4161-8585-98dcd6301f5f tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:22.653610 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ab2cb7d-e556-4161-8585-98dcd6301f5f tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:22.654111 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ab2cb7d-e556-4161-8585-98dcd6301f5f tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:22.655975 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.objects.instance [None req-6ab2cb7d-e556-4161-8585-98dcd6301f5f tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lazy-loading 'fault' on Instance uuid 463f5c61-231b-435d-b0ec-440e941d8ae1 {{(pid=120631) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:02:22.667498 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-b6598339-9037-4425-86d3-427205655bfa req-d49f8dbf-1cf1-4de1-8cd7-401726728549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c", "name": "network-vif-deleted", "tag": "d5901c41-4417-480b-839a-adeac6440d5f"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:22.677643 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-b6598339-9037-4425-86d3-427205655bfa req-d49f8dbf-1cf1-4de1-8cd7-401726728549 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:22.678363 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-b6598339-9037-4425-86d3-427205655bfa req-d49f8dbf-1cf1-4de1-8cd7-401726728549 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:22.678772 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-b6598339-9037-4425-86d3-427205655bfa req-d49f8dbf-1cf1-4de1-8cd7-401726728549 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:22.691252 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-b6598339-9037-4425-86d3-427205655bfa req-d49f8dbf-1cf1-4de1-8cd7-401726728549 service nova] Creating event network-vif-deleted:d5901c41-4417-480b-839a-adeac6440d5f for instance 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c on hv-cinder-81514 Aug 30 01:02:22.696160 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-b6598339-9037-4425-86d3-427205655bfa req-d49f8dbf-1cf1-4de1-8cd7-401726728549 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032577 Aug 30 01:02:22.696760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 103/195] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:22.707863 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6ab2cb7d-e556-4161-8585-98dcd6301f5f tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4cc89946c2e45a0a75eef16cb042758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0f91770bb14bb6920fc277936c189e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:22.718266 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-6ab2cb7d-e556-4161-8585-98dcd6301f5f tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 200 len: 1349 microversion: 2.1 time: 0.145382 Aug 30 01:02:22.718266 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 93/196] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:22 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 1349 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:23.583814 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-1a45b47f-30b2-47fc-8064-bae2aad9f26f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:23.584473 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-1a45b47f-30b2-47fc-8064-bae2aad9f26f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:23.590611 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1a45b47f-30b2-47fc-8064-bae2aad9f26f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:23.591087 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1a45b47f-30b2-47fc-8064-bae2aad9f26f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:23.591515 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1a45b47f-30b2-47fc-8064-bae2aad9f26f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:23.592919 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1a45b47f-30b2-47fc-8064-bae2aad9f26f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:23.593395 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1a45b47f-30b2-47fc-8064-bae2aad9f26f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:23.593817 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1a45b47f-30b2-47fc-8064-bae2aad9f26f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:23.607581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-9256154c-3207-40e7-b96f-8bcf44a0b026 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:23.608202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-9256154c-3207-40e7-b96f-8bcf44a0b026 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:23.614633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9256154c-3207-40e7-b96f-8bcf44a0b026 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:23.615112 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9256154c-3207-40e7-b96f-8bcf44a0b026 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:23.615538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9256154c-3207-40e7-b96f-8bcf44a0b026 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:23.616222 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9256154c-3207-40e7-b96f-8bcf44a0b026 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:23.616677 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9256154c-3207-40e7-b96f-8bcf44a0b026 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:23.617098 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9256154c-3207-40e7-b96f-8bcf44a0b026 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:23.630670 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-9256154c-3207-40e7-b96f-8bcf44a0b026 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] HTTP exception thrown: Instance 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c could not be found. Aug 30 01:02:23.635270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-9256154c-3207-40e7-b96f-8bcf44a0b026 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Request method failure captured: Aug 30 01:02:23.635270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c HTTP/1.1 Aug 30 01:02:23.635270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:02:23.635270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:02:23.635270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:02:23.635270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:02:23.635270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:02:23.635270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:02:23.635270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:02:23.635270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:02:23.635270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWGDrX_mbaFwnTQUJ0fDEH3RSzAl19NgTcJn_WlLdgp-JGF0CSyanr76yJRWr5Mmc8mf9vkNO2aEhHCKSnAdLyv6D_iXihHAMDeA3S2gsb-OsLovdgCvpNhk1sMZYXvDMR4wx-HdOU9vNWIJgyqNbwp18zJ-MGlRbJU7lbH_YX6UqRs Aug 30 01:02:23.635270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:02:23.635270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:02:23.635270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:02:23.635270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:02:23.635270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:02:23.635270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:02:23.635270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: 2c18e1da199c437b809a45aada0b0e0e Aug 30 01:02:23.635270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-VolumesActionsTest-672031182 Aug 30 01:02:23.635270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:02:23.635270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:02:23.636666 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2c18e1da199c437b809a45aada0b0e0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2c18e1da199c437b809a45aada0b0e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2c18e1da199c437b809a45aada0b0e0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2c18e1da199c437b809a45aada0b0e0e"}]}] Aug 30 01:02:23.636666 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-VolumesActionsTest-672031182 Aug 30 01:02:23.636666 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: 2c18e1da199c437b809a45aada0b0e0e Aug 30 01:02:23.636666 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-VolumesActionsTest-672031182 Aug 30 01:02:23.636666 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-VolumesActionsTest-672031182-project Aug 30 01:02:23.636666 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:02:23.636666 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:02:23.636666 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: fed877b0a569455597dfbb8b98ae0bc0 Aug 30 01:02:23.636666 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-VolumesActionsTest-672031182-project Aug 30 01:02:23.636666 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:02:23.636666 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Instance 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c could not be found. Aug 30 01:02:23.636666 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': '5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c'} Aug 30 01:02:23.641912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:02:23.641912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:23.641912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:02:23.641912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:02:23.641912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:02:23.641912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:02:23.641912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:02:23.641912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:02:23.641912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:02:23.641912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:02:23.641912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c could not be found. Aug 30 01:02:23.641912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:23.641912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:23.641912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:23.641912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:23.641912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:23.641912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:23.641912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:02:23.641912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:02:23.641912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:02:23.644140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:02:23.644140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:02:23.644140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:02:23.644140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:02:23.644140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:02:23.644140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:02:23.644140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:02:23.644140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c could not be found. Aug 30 01:02:23.644140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:23.644140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:23.644140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:23.644140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:23.644140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:23.644140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:23.644140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:02:23.644140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:02:23.644140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c could not be found. Aug 30 01:02:23.644140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:23.645858 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-9256154c-3207-40e7-b96f-8bcf44a0b026 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Returning 404 to user: Instance 5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:02:23.645858 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-9256154c-3207-40e7-b96f-8bcf44a0b026 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c" status: 404 len: 111 microversion: 2.1 time: 0.033174 Aug 30 01:02:23.645858 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 94/197] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:23 2022] GET /compute/v2.1/servers/5b6e02bc-7faf-41fa-a8f0-ddbee00ab71c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:02:23.740400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e16262ab-afc5-4a56-80e6-12bbd211f8f5 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:23.741147 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e16262ab-afc5-4a56-80e6-12bbd211f8f5 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:23.750018 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e16262ab-afc5-4a56-80e6-12bbd211f8f5 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:23.750610 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e16262ab-afc5-4a56-80e6-12bbd211f8f5 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:23.751409 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e16262ab-afc5-4a56-80e6-12bbd211f8f5 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:23.751807 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-1a45b47f-30b2-47fc-8064-bae2aad9f26f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:23.752314 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e16262ab-afc5-4a56-80e6-12bbd211f8f5 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:23.752839 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e16262ab-afc5-4a56-80e6-12bbd211f8f5 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:23.753372 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e16262ab-afc5-4a56-80e6-12bbd211f8f5 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:23.759851 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-1a45b47f-30b2-47fc-8064-bae2aad9f26f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.180706 Aug 30 01:02:23.760450 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 104/198] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:23 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:23.765554 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-aadeafc0-985d-4f06-bc9a-69a5bb33431d tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-308905633", "imageRef": "d6c817b5-c41c-4210-a963-172386e2e582", "flavorRef": "452", "networks": [{"uuid": "9d1e59dd-5b38-4842-838d-cef49c8c8701"}]}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:23.767872 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-e16262ab-afc5-4a56-80e6-12bbd211f8f5 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] HTTP exception thrown: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. Aug 30 01:02:23.769402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e16262ab-afc5-4a56-80e6-12bbd211f8f5 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Request method failure captured: Aug 30 01:02:23.769402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 HTTP/1.1 Aug 30 01:02:23.769402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:02:23.769402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:02:23.769402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:02:23.769402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:02:23.769402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:02:23.769402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:02:23.769402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:02:23.769402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:02:23.769402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWFf12tV3IvIiDHUQ1v-cRwkggkYzUhFfvUbGrq2jYh_gDWbE-zHkMTejo1l3UYH4asrZxHDnJVHQTJxZEnBlBSIgmnogTZ2GcTNdg119vtFT_R0YC1pwLg2ynOomzY_5we8n_gF9fqesZNWVuQyRQt_bN_2MEdFVL3LF1K5mcOSGSo Aug 30 01:02:23.769402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:02:23.769402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:02:23.769402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:02:23.769402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:02:23.769402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:02:23.769402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:02:23.769402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: 0c0f91770bb14bb6920fc277936c189e Aug 30 01:02:23.769402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-DeleteServersTestJSON-226926882 Aug 30 01:02:23.769402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:02:23.769402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:02:23.770526 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0c0f91770bb14bb6920fc277936c189e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c0f91770bb14bb6920fc277936c189e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0c0f91770bb14bb6920fc277936c189e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c0f91770bb14bb6920fc277936c189e"}]}] Aug 30 01:02:23.770526 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-DeleteServersTestJSON-226926882 Aug 30 01:02:23.770526 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: 0c0f91770bb14bb6920fc277936c189e Aug 30 01:02:23.770526 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-DeleteServersTestJSON-226926882 Aug 30 01:02:23.770526 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-DeleteServersTestJSON-226926882-project Aug 30 01:02:23.770526 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:02:23.770526 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:02:23.770526 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: e4cc89946c2e45a0a75eef16cb042758 Aug 30 01:02:23.770526 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-DeleteServersTestJSON-226926882-project Aug 30 01:02:23.770526 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:02:23.770526 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. Aug 30 01:02:23.770526 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': '463f5c61-231b-435d-b0ec-440e941d8ae1'} Aug 30 01:02:23.771195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:02:23.771195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:23.771195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:02:23.771195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:02:23.771195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:02:23.771195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:02:23.771195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:02:23.771195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:02:23.771195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:02:23.771195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:02:23.771195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. Aug 30 01:02:23.771195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:23.771195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:23.771195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:23.771195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:23.771195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:23.771195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:23.771195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:02:23.771195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:02:23.771195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:02:23.772316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:02:23.772316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:02:23.772316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:02:23.772316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:02:23.772316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:02:23.772316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:02:23.772316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:02:23.772316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. Aug 30 01:02:23.772316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:23.772316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:23.772316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:23.772316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:23.772316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:23.772316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:23.772316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:02:23.772316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:02:23.772316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. Aug 30 01:02:23.772316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:23.773588 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e16262ab-afc5-4a56-80e6-12bbd211f8f5 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Returning 404 to user: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:02:23.773588 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e16262ab-afc5-4a56-80e6-12bbd211f8f5 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 404 len: 111 microversion: 2.1 time: 0.035137 Aug 30 01:02:23.773588 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 95/199] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:23 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:02:23.826005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.network.neutron [None req-aadeafc0-985d-4f06-bc9a-69a5bb33431d tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] validate_networks() for [('9d1e59dd-5b38-4842-838d-cef49c8c8701', None, None, None, None, None)] {{(pid=120630) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:02:23.885685 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-a353487c-2b3f-4b12-9647-29db1db6d281 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:23.888300 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-a353487c-2b3f-4b12-9647-29db1db6d281 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:23.895801 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a353487c-2b3f-4b12-9647-29db1db6d281 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:23.896280 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a353487c-2b3f-4b12-9647-29db1db6d281 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:23.896710 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a353487c-2b3f-4b12-9647-29db1db6d281 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:23.897435 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a353487c-2b3f-4b12-9647-29db1db6d281 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:23.897885 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a353487c-2b3f-4b12-9647-29db1db6d281 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:23.898306 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a353487c-2b3f-4b12-9647-29db1db6d281 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:23.912146 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-a353487c-2b3f-4b12-9647-29db1db6d281 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] HTTP exception thrown: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. Aug 30 01:02:23.913961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-a353487c-2b3f-4b12-9647-29db1db6d281 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Request method failure captured: Aug 30 01:02:23.913961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1/os-volume_attachments HTTP/1.1 Aug 30 01:02:23.913961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:02:23.913961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:02:23.913961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:02:23.913961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:02:23.913961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:02:23.913961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:02:23.913961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:02:23.913961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:02:23.913961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWFf12tV3IvIiDHUQ1v-cRwkggkYzUhFfvUbGrq2jYh_gDWbE-zHkMTejo1l3UYH4asrZxHDnJVHQTJxZEnBlBSIgmnogTZ2GcTNdg119vtFT_R0YC1pwLg2ynOomzY_5we8n_gF9fqesZNWVuQyRQt_bN_2MEdFVL3LF1K5mcOSGSo Aug 30 01:02:23.913961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:02:23.913961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:02:23.913961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:02:23.913961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:02:23.913961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:02:23.913961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:02:23.913961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: 0c0f91770bb14bb6920fc277936c189e Aug 30 01:02:23.913961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-DeleteServersTestJSON-226926882 Aug 30 01:02:23.913961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:02:23.913961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:02:23.915160 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0c0f91770bb14bb6920fc277936c189e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c0f91770bb14bb6920fc277936c189e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0c0f91770bb14bb6920fc277936c189e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c0f91770bb14bb6920fc277936c189e"}]}] Aug 30 01:02:23.915160 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-DeleteServersTestJSON-226926882 Aug 30 01:02:23.915160 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: 0c0f91770bb14bb6920fc277936c189e Aug 30 01:02:23.915160 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-DeleteServersTestJSON-226926882 Aug 30 01:02:23.915160 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-DeleteServersTestJSON-226926882-project Aug 30 01:02:23.915160 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:02:23.915160 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:02:23.915160 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: e4cc89946c2e45a0a75eef16cb042758 Aug 30 01:02:23.915160 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-DeleteServersTestJSON-226926882-project Aug 30 01:02:23.915160 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:02:23.915160 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. Aug 30 01:02:23.915160 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'server_id': '463f5c61-231b-435d-b0ec-440e941d8ae1'} Aug 30 01:02:23.915826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:02:23.915826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:23.915826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:02:23.915826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:02:23.915826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:02:23.915826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:02:23.915826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:02:23.915826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:02:23.915826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:02:23.915826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:02:23.915826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. Aug 30 01:02:23.915826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:23.915826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:23.915826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:23.915826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:23.915826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:23.915826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:23.915826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:02:23.915826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:02:23.915826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:02:23.916944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:02:23.916944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 01:02:23.916944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:02:23.916944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 01:02:23.916944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:02:23.916944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 01:02:23.916944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 01:02:23.916944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:02:23.916944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:02:23.916944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. Aug 30 01:02:23.916944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:23.916944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:23.916944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:23.916944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:23.916944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:23.916944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:23.916944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:02:23.916944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:02:23.916944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. Aug 30 01:02:23.916944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:23.918063 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-a353487c-2b3f-4b12-9647-29db1db6d281 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Returning 404 to user: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:02:23.918063 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-a353487c-2b3f-4b12-9647-29db1db6d281 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034137 Aug 30 01:02:23.918063 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 96/200] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:02:23 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:02:24.194857 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-aadeafc0-985d-4f06-bc9a-69a5bb33431d tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Flavor limits 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:02:24.195277 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-aadeafc0-985d-4f06-bc9a-69a5bb33431d tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Image limits 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:02:24.195774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-aadeafc0-985d-4f06-bc9a-69a5bb33431d tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Flavor pref 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:02:24.196274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-aadeafc0-985d-4f06-bc9a-69a5bb33431d tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Image pref 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:02:24.196684 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-aadeafc0-985d-4f06-bc9a-69a5bb33431d tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:02:24.205898 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aadeafc0-985d-4f06-bc9a-69a5bb33431d tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:24.206372 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aadeafc0-985d-4f06-bc9a-69a5bb33431d tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:24.206807 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aadeafc0-985d-4f06-bc9a-69a5bb33431d tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:24.207646 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aadeafc0-985d-4f06-bc9a-69a5bb33431d tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:24.208140 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aadeafc0-985d-4f06-bc9a-69a5bb33431d tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:24.208559 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aadeafc0-985d-4f06-bc9a-69a5bb33431d tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:24.226374 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-aadeafc0-985d-4f06-bc9a-69a5bb33431d tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Getting quotas for project 2c18e1da199c437b809a45aada0b0e0e. Resources: {'ram', 'instances', 'cores'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:02:24.230587 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-aadeafc0-985d-4f06-bc9a-69a5bb33431d tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Getting quotas for user fed877b0a569455597dfbb8b98ae0bc0 and project 2c18e1da199c437b809a45aada0b0e0e. Resources: {'ram', 'instances', 'cores'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:02:24.242871 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-aadeafc0-985d-4f06-bc9a-69a5bb33431d tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Going to run 1 instances... {{(pid=120630) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:02:24.245331 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-aadeafc0-985d-4f06-bc9a-69a5bb33431d tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: bc409b85-eeb9-4a88-9654-57063837c27e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6c817b5-c41c-4210-a963-172386e2e582',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:02:24.297336 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-aadeafc0-985d-4f06-bc9a-69a5bb33431d tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535511 Aug 30 01:02:24.298331 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 105/201] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 30 01:02:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:02:24.310417 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-022bdf9d-3486-4076-8536-14d0b74a0b04 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:24.311217 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-022bdf9d-3486-4076-8536-14d0b74a0b04 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: bc409b85-eeb9-4a88-9654-57063837c27e] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:24.375615 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-022bdf9d-3486-4076-8536-14d0b74a0b04 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:24.397396 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-022bdf9d-3486-4076-8536-14d0b74a0b04 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e" status: 200 len: 1213 microversion: 2.1 time: 0.091601 Aug 30 01:02:24.397979 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 97/202] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:24 2022] GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:24.784573 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8cb84b06-0089-4e69-8bb3-cd8633deea6a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:24.785390 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8cb84b06-0089-4e69-8bb3-cd8633deea6a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:24.792723 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8cb84b06-0089-4e69-8bb3-cd8633deea6a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:24.793347 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8cb84b06-0089-4e69-8bb3-cd8633deea6a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:24.793858 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8cb84b06-0089-4e69-8bb3-cd8633deea6a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:24.795029 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8cb84b06-0089-4e69-8bb3-cd8633deea6a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:24.795627 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8cb84b06-0089-4e69-8bb3-cd8633deea6a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:24.796102 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8cb84b06-0089-4e69-8bb3-cd8633deea6a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:24.931025 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8cb84b06-0089-4e69-8bb3-cd8633deea6a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:24.939216 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8cb84b06-0089-4e69-8bb3-cd8633deea6a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.159651 Aug 30 01:02:24.939781 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 106/203] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:24 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:25.116405 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0d98049e-ada9-468d-8e77-1312345b82fa tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:25.116904 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-0d98049e-ada9-468d-8e77-1312345b82fa tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:25.123424 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0d98049e-ada9-468d-8e77-1312345b82fa tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:25.124060 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0d98049e-ada9-468d-8e77-1312345b82fa tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:25.124594 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0d98049e-ada9-468d-8e77-1312345b82fa tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:25.125236 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0d98049e-ada9-468d-8e77-1312345b82fa tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:25.125689 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0d98049e-ada9-468d-8e77-1312345b82fa tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:25.126229 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0d98049e-ada9-468d-8e77-1312345b82fa tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:25.140712 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-0d98049e-ada9-468d-8e77-1312345b82fa tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] HTTP exception thrown: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. Aug 30 01:02:25.142272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0d98049e-ada9-468d-8e77-1312345b82fa tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Request method failure captured: Aug 30 01:02:25.142272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: DELETE /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 HTTP/1.1 Aug 30 01:02:25.142272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:02:25.142272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:02:25.142272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:02:25.142272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:02:25.142272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:02:25.142272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:02:25.142272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:02:25.142272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:02:25.142272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWFf12tV3IvIiDHUQ1v-cRwkggkYzUhFfvUbGrq2jYh_gDWbE-zHkMTejo1l3UYH4asrZxHDnJVHQTJxZEnBlBSIgmnogTZ2GcTNdg119vtFT_R0YC1pwLg2ynOomzY_5we8n_gF9fqesZNWVuQyRQt_bN_2MEdFVL3LF1K5mcOSGSo Aug 30 01:02:25.142272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:02:25.142272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:02:25.142272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:02:25.142272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:02:25.142272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:02:25.142272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:02:25.142272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: 0c0f91770bb14bb6920fc277936c189e Aug 30 01:02:25.142272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-DeleteServersTestJSON-226926882 Aug 30 01:02:25.142272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:02:25.142272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:02:25.143538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0c0f91770bb14bb6920fc277936c189e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c0f91770bb14bb6920fc277936c189e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0c0f91770bb14bb6920fc277936c189e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c0f91770bb14bb6920fc277936c189e"}]}] Aug 30 01:02:25.143538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-DeleteServersTestJSON-226926882 Aug 30 01:02:25.143538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: 0c0f91770bb14bb6920fc277936c189e Aug 30 01:02:25.143538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-DeleteServersTestJSON-226926882 Aug 30 01:02:25.143538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-DeleteServersTestJSON-226926882-project Aug 30 01:02:25.143538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:02:25.143538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:02:25.143538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: e4cc89946c2e45a0a75eef16cb042758 Aug 30 01:02:25.143538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-DeleteServersTestJSON-226926882-project Aug 30 01:02:25.143538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:02:25.143538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. Aug 30 01:02:25.143538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': '463f5c61-231b-435d-b0ec-440e941d8ae1'} Aug 30 01:02:25.144214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:02:25.144214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:25.144214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:02:25.144214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:02:25.144214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:02:25.144214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:02:25.144214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:02:25.144214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:02:25.144214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:02:25.144214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:02:25.144214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. Aug 30 01:02:25.144214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:25.144214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:25.144214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:25.144214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:25.144214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:25.144214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:25.144214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:02:25.144214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:02:25.144214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:02:25.145368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:02:25.145368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:02:25.145368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:02:25.145368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:02:25.145368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:02:25.145368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:02:25.145368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:02:25.145368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:02:25.145368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:02:25.145368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. Aug 30 01:02:25.145368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:25.145368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:25.145368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:25.145368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:25.145368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:25.145368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:25.145368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:02:25.145368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:02:25.145368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. Aug 30 01:02:25.145368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:25.146864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0d98049e-ada9-468d-8e77-1312345b82fa tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Returning 404 to user: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:02:25.146864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0d98049e-ada9-468d-8e77-1312345b82fa tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "DELETE /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 404 len: 111 microversion: 2.1 time: 0.031045 Aug 30 01:02:25.146864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 98/204] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:02:25 2022] DELETE /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:02:25.152296 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-3dc4a687-3190-45b8-8123-0039f39bd846 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:25.152908 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-3dc4a687-3190-45b8-8123-0039f39bd846 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] [instance: 463f5c61-231b-435d-b0ec-440e941d8ae1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:25.159106 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3dc4a687-3190-45b8-8123-0039f39bd846 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:25.159590 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3dc4a687-3190-45b8-8123-0039f39bd846 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:25.160021 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3dc4a687-3190-45b8-8123-0039f39bd846 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:25.160709 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3dc4a687-3190-45b8-8123-0039f39bd846 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:25.161194 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3dc4a687-3190-45b8-8123-0039f39bd846 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:25.161779 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3dc4a687-3190-45b8-8123-0039f39bd846 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:25.175953 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-3dc4a687-3190-45b8-8123-0039f39bd846 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] HTTP exception thrown: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. Aug 30 01:02:25.180702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-3dc4a687-3190-45b8-8123-0039f39bd846 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Request method failure captured: Aug 30 01:02:25.180702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 HTTP/1.1 Aug 30 01:02:25.180702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:02:25.180702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:02:25.180702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:02:25.180702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:02:25.180702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:02:25.180702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:02:25.180702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:02:25.180702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:02:25.180702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWFf12tV3IvIiDHUQ1v-cRwkggkYzUhFfvUbGrq2jYh_gDWbE-zHkMTejo1l3UYH4asrZxHDnJVHQTJxZEnBlBSIgmnogTZ2GcTNdg119vtFT_R0YC1pwLg2ynOomzY_5we8n_gF9fqesZNWVuQyRQt_bN_2MEdFVL3LF1K5mcOSGSo Aug 30 01:02:25.180702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:02:25.180702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:02:25.180702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:02:25.180702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:02:25.180702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:02:25.180702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:02:25.180702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: 0c0f91770bb14bb6920fc277936c189e Aug 30 01:02:25.180702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-DeleteServersTestJSON-226926882 Aug 30 01:02:25.180702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:02:25.180702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:02:25.182046 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0c0f91770bb14bb6920fc277936c189e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c0f91770bb14bb6920fc277936c189e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0c0f91770bb14bb6920fc277936c189e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c0f91770bb14bb6920fc277936c189e"}]}] Aug 30 01:02:25.182046 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-DeleteServersTestJSON-226926882 Aug 30 01:02:25.182046 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: 0c0f91770bb14bb6920fc277936c189e Aug 30 01:02:25.182046 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-DeleteServersTestJSON-226926882 Aug 30 01:02:25.182046 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-DeleteServersTestJSON-226926882-project Aug 30 01:02:25.182046 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:02:25.182046 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:02:25.182046 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: e4cc89946c2e45a0a75eef16cb042758 Aug 30 01:02:25.182046 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-DeleteServersTestJSON-226926882-project Aug 30 01:02:25.182046 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:02:25.182046 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. Aug 30 01:02:25.182046 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': '463f5c61-231b-435d-b0ec-440e941d8ae1'} Aug 30 01:02:25.182681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:02:25.182681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:25.182681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:02:25.182681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:02:25.182681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:02:25.182681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:02:25.182681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:02:25.182681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:02:25.182681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:02:25.182681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:02:25.182681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. Aug 30 01:02:25.182681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:25.182681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:25.182681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:25.182681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:25.182681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:25.182681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:25.182681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:02:25.182681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:02:25.182681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:02:25.183760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:02:25.183760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:02:25.183760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:02:25.183760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:02:25.183760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:02:25.183760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:02:25.183760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:02:25.183760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. Aug 30 01:02:25.183760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:25.183760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:25.183760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:25.183760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:25.183760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:25.183760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:25.183760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:02:25.183760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:02:25.183760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. Aug 30 01:02:25.183760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:25.184701 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-3dc4a687-3190-45b8-8123-0039f39bd846 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] Returning 404 to user: Instance 463f5c61-231b-435d-b0ec-440e941d8ae1 could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:02:25.184701 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-3dc4a687-3190-45b8-8123-0039f39bd846 tempest-DeleteServersTestJSON-226926882 tempest-DeleteServersTestJSON-226926882-project] 10.222.0.78 "GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1" status: 404 len: 111 microversion: 2.1 time: 0.033828 Aug 30 01:02:25.184701 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 107/205] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:25 2022] GET /compute/v2.1/servers/463f5c61-231b-435d-b0ec-440e941d8ae1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:02:25.418377 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-7c3b511e-8a14-433b-b6e0-485075313543 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:25.418977 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-7c3b511e-8a14-433b-b6e0-485075313543 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: bc409b85-eeb9-4a88-9654-57063837c27e] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:25.425760 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7c3b511e-8a14-433b-b6e0-485075313543 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:25.426239 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7c3b511e-8a14-433b-b6e0-485075313543 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:25.426667 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7c3b511e-8a14-433b-b6e0-485075313543 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:25.427352 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7c3b511e-8a14-433b-b6e0-485075313543 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:25.427797 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7c3b511e-8a14-433b-b6e0-485075313543 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:25.428213 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7c3b511e-8a14-433b-b6e0-485075313543 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:25.514816 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-7c3b511e-8a14-433b-b6e0-485075313543 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:25.522451 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-7c3b511e-8a14-433b-b6e0-485075313543 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e" status: 200 len: 1265 microversion: 2.1 time: 0.107881 Aug 30 01:02:25.523009 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 99/206] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:25 2022] GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e => generated 1265 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:25.962398 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8a34735b-903b-4725-a470-2cc85a0b0535 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:25.963810 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8a34735b-903b-4725-a470-2cc85a0b0535 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:25.973707 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a34735b-903b-4725-a470-2cc85a0b0535 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:25.974786 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a34735b-903b-4725-a470-2cc85a0b0535 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:25.974786 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a34735b-903b-4725-a470-2cc85a0b0535 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:25.975290 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a34735b-903b-4725-a470-2cc85a0b0535 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:25.975734 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a34735b-903b-4725-a470-2cc85a0b0535 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:25.976147 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a34735b-903b-4725-a470-2cc85a0b0535 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:26.359924 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8a34735b-903b-4725-a470-2cc85a0b0535 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:26.367727 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8a34735b-903b-4725-a470-2cc85a0b0535 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.411786 Aug 30 01:02:26.368301 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 108/207] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:25 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:26.547300 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-713faee6-da56-4083-880f-28be62341cd6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:26.547921 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-713faee6-da56-4083-880f-28be62341cd6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: bc409b85-eeb9-4a88-9654-57063837c27e] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:26.560730 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-713faee6-da56-4083-880f-28be62341cd6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:26.561606 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-713faee6-da56-4083-880f-28be62341cd6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:26.562045 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-713faee6-da56-4083-880f-28be62341cd6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:26.562761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-713faee6-da56-4083-880f-28be62341cd6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:26.563272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-713faee6-da56-4083-880f-28be62341cd6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:26.563696 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-713faee6-da56-4083-880f-28be62341cd6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:26.678733 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-713faee6-da56-4083-880f-28be62341cd6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:26.687214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-713faee6-da56-4083-880f-28be62341cd6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e" status: 200 len: 1271 microversion: 2.1 time: 0.144895 Aug 30 01:02:26.687787 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 100/208] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:26 2022] GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e => generated 1271 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:27.390593 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-e9769f23-9c7b-474a-ac8a-0e85da0824ef tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:27.391198 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-e9769f23-9c7b-474a-ac8a-0e85da0824ef tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:27.398046 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e9769f23-9c7b-474a-ac8a-0e85da0824ef tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:27.398534 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e9769f23-9c7b-474a-ac8a-0e85da0824ef tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:27.398963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e9769f23-9c7b-474a-ac8a-0e85da0824ef tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:27.399662 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e9769f23-9c7b-474a-ac8a-0e85da0824ef tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:27.400111 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e9769f23-9c7b-474a-ac8a-0e85da0824ef tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:27.400540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e9769f23-9c7b-474a-ac8a-0e85da0824ef tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:27.709671 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-42082c73-b9a3-46ba-adf3-b907bdd3f8dd tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:27.710852 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-42082c73-b9a3-46ba-adf3-b907bdd3f8dd tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: bc409b85-eeb9-4a88-9654-57063837c27e] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:27.717414 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-42082c73-b9a3-46ba-adf3-b907bdd3f8dd tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:27.717940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-42082c73-b9a3-46ba-adf3-b907bdd3f8dd tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:27.718344 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-42082c73-b9a3-46ba-adf3-b907bdd3f8dd tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:27.719132 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-42082c73-b9a3-46ba-adf3-b907bdd3f8dd tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:27.719900 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-42082c73-b9a3-46ba-adf3-b907bdd3f8dd tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:27.720382 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-42082c73-b9a3-46ba-adf3-b907bdd3f8dd tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:27.938207 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-e9769f23-9c7b-474a-ac8a-0e85da0824ef tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:27.945823 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-e9769f23-9c7b-474a-ac8a-0e85da0824ef tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.559914 Aug 30 01:02:27.946394 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 109/209] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:27 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:28.037224 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-42082c73-b9a3-46ba-adf3-b907bdd3f8dd tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:28.045791 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-42082c73-b9a3-46ba-adf3-b907bdd3f8dd tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e" status: 200 len: 1313 microversion: 2.1 time: 0.340691 Aug 30 01:02:28.046421 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 101/210] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:27 2022] GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:28.488744 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-a399d6e9-f8be-4b1a-b16d-24823cfe3715 req-43f3a397-5b75-4e6a-93c1-a92d26769466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc409b85-eeb9-4a88-9654-57063837c27e", "tag": "d7d904e2-afb6-421e-9526-494607fa1712"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:28.508380 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-a399d6e9-f8be-4b1a-b16d-24823cfe3715 req-43f3a397-5b75-4e6a-93c1-a92d26769466 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:28.509964 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-a399d6e9-f8be-4b1a-b16d-24823cfe3715 req-43f3a397-5b75-4e6a-93c1-a92d26769466 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:28.510628 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-a399d6e9-f8be-4b1a-b16d-24823cfe3715 req-43f3a397-5b75-4e6a-93c1-a92d26769466 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:28.539416 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-a399d6e9-f8be-4b1a-b16d-24823cfe3715 req-43f3a397-5b75-4e6a-93c1-a92d26769466 service nova] Creating event network-changed:d7d904e2-afb6-421e-9526-494607fa1712 for instance bc409b85-eeb9-4a88-9654-57063837c27e on hv-cinder-81514 Aug 30 01:02:28.547841 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-a399d6e9-f8be-4b1a-b16d-24823cfe3715 req-43f3a397-5b75-4e6a-93c1-a92d26769466 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063279 Aug 30 01:02:28.550404 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 110/211] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:02:28.970085 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-57768172-f5f2-47bb-9858-c547038844ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:28.970732 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-57768172-f5f2-47bb-9858-c547038844ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:28.982984 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-57768172-f5f2-47bb-9858-c547038844ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:28.986150 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-57768172-f5f2-47bb-9858-c547038844ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:28.986820 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-57768172-f5f2-47bb-9858-c547038844ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:28.987881 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-57768172-f5f2-47bb-9858-c547038844ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:28.988497 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-57768172-f5f2-47bb-9858-c547038844ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:28.989112 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-57768172-f5f2-47bb-9858-c547038844ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:29.072130 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4c76519a-8a3a-47ba-be86-7eaa7da9389b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:29.072858 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-4c76519a-8a3a-47ba-be86-7eaa7da9389b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: bc409b85-eeb9-4a88-9654-57063837c27e] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:29.083444 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c76519a-8a3a-47ba-be86-7eaa7da9389b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:29.084213 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c76519a-8a3a-47ba-be86-7eaa7da9389b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:29.085302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c76519a-8a3a-47ba-be86-7eaa7da9389b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:29.086320 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c76519a-8a3a-47ba-be86-7eaa7da9389b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:29.086933 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c76519a-8a3a-47ba-be86-7eaa7da9389b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:29.088368 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c76519a-8a3a-47ba-be86-7eaa7da9389b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:29.396997 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-57768172-f5f2-47bb-9858-c547038844ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:29.413711 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-57768172-f5f2-47bb-9858-c547038844ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.450348 Aug 30 01:02:29.429957 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 102/212] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:28 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:29.464840 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-4c76519a-8a3a-47ba-be86-7eaa7da9389b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:29.478218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-4c76519a-8a3a-47ba-be86-7eaa7da9389b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e" status: 200 len: 1313 microversion: 2.1 time: 0.410141 Aug 30 01:02:29.482836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 111/213] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:29 2022] GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:30.439266 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-1726aaa2-32b7-442e-a533-c187ec9bbc8a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:30.440140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-1726aaa2-32b7-442e-a533-c187ec9bbc8a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:30.460916 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1726aaa2-32b7-442e-a533-c187ec9bbc8a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:30.474364 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1726aaa2-32b7-442e-a533-c187ec9bbc8a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:30.474961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1726aaa2-32b7-442e-a533-c187ec9bbc8a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:30.476150 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1726aaa2-32b7-442e-a533-c187ec9bbc8a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:30.476763 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1726aaa2-32b7-442e-a533-c187ec9bbc8a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:30.477462 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1726aaa2-32b7-442e-a533-c187ec9bbc8a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:30.503447 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-9ef7e4f9-5cfc-4d17-a0c7-2b09de33c2a6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:30.504148 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-9ef7e4f9-5cfc-4d17-a0c7-2b09de33c2a6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: bc409b85-eeb9-4a88-9654-57063837c27e] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:30.514141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9ef7e4f9-5cfc-4d17-a0c7-2b09de33c2a6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:30.515386 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9ef7e4f9-5cfc-4d17-a0c7-2b09de33c2a6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:30.518098 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9ef7e4f9-5cfc-4d17-a0c7-2b09de33c2a6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:30.519121 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9ef7e4f9-5cfc-4d17-a0c7-2b09de33c2a6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:30.519733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9ef7e4f9-5cfc-4d17-a0c7-2b09de33c2a6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:30.520302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9ef7e4f9-5cfc-4d17-a0c7-2b09de33c2a6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:30.845591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-9ef7e4f9-5cfc-4d17-a0c7-2b09de33c2a6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:30.850741 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-9ef7e4f9-5cfc-4d17-a0c7-2b09de33c2a6 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e" status: 200 len: 1313 microversion: 2.1 time: 0.351446 Aug 30 01:02:30.851523 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 112/214] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:30 2022] GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:30.857306 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-1726aaa2-32b7-442e-a533-c187ec9bbc8a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:30.866547 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-1726aaa2-32b7-442e-a533-c187ec9bbc8a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.434676 Aug 30 01:02:30.867183 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 103/215] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:30 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:31.871301 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0a0fc2f1-bf74-4019-afc1-6d65544955d1 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:31.872895 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-0a0fc2f1-bf74-4019-afc1-6d65544955d1 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: bc409b85-eeb9-4a88-9654-57063837c27e] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:31.878754 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0a0fc2f1-bf74-4019-afc1-6d65544955d1 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:31.879401 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0a0fc2f1-bf74-4019-afc1-6d65544955d1 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:31.879830 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0a0fc2f1-bf74-4019-afc1-6d65544955d1 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:31.880517 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0a0fc2f1-bf74-4019-afc1-6d65544955d1 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:31.880980 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0a0fc2f1-bf74-4019-afc1-6d65544955d1 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:31.881415 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0a0fc2f1-bf74-4019-afc1-6d65544955d1 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:31.899768 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=100 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:31.930677 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-11975b63-ecb9-44c9-afff-9219e82aad0d tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] Action: 'create', calling method: .version_select at 0x7f0f528e4af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-168015580", "metadata": {"Type": "work"}}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:31.940981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-11975b63-ecb9-44c9-afff-9219e82aad0d tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] Request method failure captured: Aug 30 01:02:31.940981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 01:02:31.940981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:02:31.940981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:02:31.940981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:02:31.940981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 121 Aug 30 01:02:31.940981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:02:31.940981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:02:31.940981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:02:31.940981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:02:31.940981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWGnW1aiZ64tINnaceT693NMITt2PJH1Gr04ezFdiLBzFDrCM0dAB3JiUYhug0_zlIA45mYZD0maflw8aOaCo8cRsxcnCB532jVw6Z7Fm57nU_z4JVGOEsG6eDtAP21cUOVXrxWYALeW9HrX6-76nPq8J7TGrLM53b7JkeDmqVrZqSg Aug 30 01:02:31.940981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:02:31.940981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:02:31.940981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:02:31.940981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:02:31.940981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:02:31.940981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:02:31.940981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: 92ca392a802e4d1eb0f3078a9c17b78d Aug 30 01:02:31.940981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-VolumesNegativeTest-1959927575 Aug 30 01:02:31.940981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:02:31.940981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:02:31.942630 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_92ca392a802e4d1eb0f3078a9c17b78d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/92ca392a802e4d1eb0f3078a9c17b78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/92ca392a802e4d1eb0f3078a9c17b78d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/92ca392a802e4d1eb0f3078a9c17b78d"}]}] Aug 30 01:02:31.942630 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-VolumesNegativeTest-1959927575 Aug 30 01:02:31.942630 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: 92ca392a802e4d1eb0f3078a9c17b78d Aug 30 01:02:31.942630 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-VolumesNegativeTest-1959927575 Aug 30 01:02:31.942630 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-VolumesNegativeTest-1959927575-project Aug 30 01:02:31.942630 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:02:31.942630 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:02:31.942630 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: f7ce3a318fcc408eaaab38f28e9751b8 Aug 30 01:02:31.942630 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-VolumesNegativeTest-1959927575-project Aug 30 01:02:31.942630 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Aug 30 01:02:31.942630 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-168015580", "metadata": {"Type": "work"}}} Aug 30 01:02:31.942630 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: Aug 30 01:02:31.942630 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 01:02:31.943518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-168015580', 'metadata': {'Type': 'work'}}}} Aug 30 01:02:31.943518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:02:31.943518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:31.943518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 01:02:31.943518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 01:02:31.943518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 01:02:31.943518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise error Aug 30 01:02:31.943518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 30 01:02:31.943518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:31.943518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 01:02:31.943518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 01:02:31.943518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:31.943518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 01:02:31.943518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi '#$%' Aug 30 01:02:31.943518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:31.943518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:31.943518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:31.943518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:31.943518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:31.943518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:31.943518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:02:31.943518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:02:31.949382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:02:31.949382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:02:31.949382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:02:31.949382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:02:31.949382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 01:02:31.949382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 01:02:31.949382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 01:02:31.949382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 01:02:31.949382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 01:02:31.949382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 01:02:31.949382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 01:02:31.949382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:31.949382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:31.949382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:31.949382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:31.949382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:31.949382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:31.949382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 01:02:31.949382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 01:02:31.950894 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 01:02:31.950894 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:31.950894 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-11975b63-ecb9-44c9-afff-9219e82aad0d tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:02:31.950894 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-11975b63-ecb9-44c9-afff-9219e82aad0d tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.134439 Aug 30 01:02:31.950894 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 113/216] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Aug 30 01:02:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:02:31.954811 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-216e49cf-1b9e-4d38-9f19-880d8629baf3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:31.955520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-216e49cf-1b9e-4d38-9f19-880d8629baf3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:31.963425 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-216e49cf-1b9e-4d38-9f19-880d8629baf3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:31.963975 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-216e49cf-1b9e-4d38-9f19-880d8629baf3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:31.964510 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-216e49cf-1b9e-4d38-9f19-880d8629baf3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:31.965260 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-216e49cf-1b9e-4d38-9f19-880d8629baf3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:31.965713 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-216e49cf-1b9e-4d38-9f19-880d8629baf3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:31.966137 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-216e49cf-1b9e-4d38-9f19-880d8629baf3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:32.055723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-0a0fc2f1-bf74-4019-afc1-6d65544955d1 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:32.063549 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0a0fc2f1-bf74-4019-afc1-6d65544955d1 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e" status: 200 len: 1313 microversion: 2.1 time: 0.196369 Aug 30 01:02:32.064127 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 104/217] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:31 2022] GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:32.079167 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-920d1532-382f-46dd-b992-db7580ed40d3 tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] Action: 'create', calling method: .version_select at 0x7f0f528eeaf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-885249220", "metadata": {"Type": "work"}}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:32.083683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-920d1532-382f-46dd-b992-db7580ed40d3 tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] Request method failure captured: Aug 30 01:02:32.083683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 01:02:32.083683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:02:32.083683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:02:32.083683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:02:32.083683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 119 Aug 30 01:02:32.083683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:02:32.083683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:02:32.083683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:02:32.083683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:02:32.083683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWGnW1aiZ64tINnaceT693NMITt2PJH1Gr04ezFdiLBzFDrCM0dAB3JiUYhug0_zlIA45mYZD0maflw8aOaCo8cRsxcnCB532jVw6Z7Fm57nU_z4JVGOEsG6eDtAP21cUOVXrxWYALeW9HrX6-76nPq8J7TGrLM53b7JkeDmqVrZqSg Aug 30 01:02:32.083683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:02:32.083683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:02:32.083683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:02:32.083683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:02:32.083683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:02:32.083683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:02:32.083683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: 92ca392a802e4d1eb0f3078a9c17b78d Aug 30 01:02:32.083683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-VolumesNegativeTest-1959927575 Aug 30 01:02:32.083683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:02:32.083683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:02:32.084855 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_92ca392a802e4d1eb0f3078a9c17b78d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/92ca392a802e4d1eb0f3078a9c17b78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/92ca392a802e4d1eb0f3078a9c17b78d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/92ca392a802e4d1eb0f3078a9c17b78d"}]}] Aug 30 01:02:32.084855 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-VolumesNegativeTest-1959927575 Aug 30 01:02:32.084855 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: 92ca392a802e4d1eb0f3078a9c17b78d Aug 30 01:02:32.084855 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-VolumesNegativeTest-1959927575 Aug 30 01:02:32.084855 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-VolumesNegativeTest-1959927575-project Aug 30 01:02:32.084855 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:02:32.084855 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:02:32.084855 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: f7ce3a318fcc408eaaab38f28e9751b8 Aug 30 01:02:32.084855 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-VolumesNegativeTest-1959927575-project Aug 30 01:02:32.084855 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Aug 30 01:02:32.084855 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-885249220", "metadata": {"Type": "work"}}} Aug 30 01:02:32.084855 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: Aug 30 01:02:32.084855 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 01:02:32.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-885249220', 'metadata': {'Type': 'work'}}}} Aug 30 01:02:32.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:02:32.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:32.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 01:02:32.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 01:02:32.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 01:02:32.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise error Aug 30 01:02:32.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 01:02:32.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 30 01:02:32.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 01:02:32.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 01:02:32.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi '0' Aug 30 01:02:32.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:32.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:32.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:32.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:32.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:02:32.085581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:02:32.086725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:02:32.086725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:02:32.086725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:02:32.086725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:02:32.086725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 01:02:32.086725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 01:02:32.086725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 01:02:32.086725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 01:02:32.086725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 01:02:32.086725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 01:02:32.086725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 01:02:32.086725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.086725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:32.086725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.086725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:32.086725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:32.086725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:32.086725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 01:02:32.086725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 01:02:32.087724 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 01:02:32.087724 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.087724 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-920d1532-382f-46dd-b992-db7580ed40d3 tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:02:32.087724 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-920d1532-382f-46dd-b992-db7580ed40d3 tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009651 Aug 30 01:02:32.087724 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 105/218] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Aug 30 01:02:32 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:02:32.094867 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-7a241b67-cb58-482c-a95b-4f29577ad7b8 tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] Action: 'create', calling method: .version_select at 0x7f0f528d68b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-758545837", "metadata": {"Type": "work"}}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:32.098370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-7a241b67-cb58-482c-a95b-4f29577ad7b8 tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] Request method failure captured: Aug 30 01:02:32.098370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 01:02:32.098370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:02:32.098370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:02:32.098370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:02:32.098370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 118 Aug 30 01:02:32.098370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:02:32.098370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:02:32.098370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:02:32.098370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:02:32.098370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWGnW1aiZ64tINnaceT693NMITt2PJH1Gr04ezFdiLBzFDrCM0dAB3JiUYhug0_zlIA45mYZD0maflw8aOaCo8cRsxcnCB532jVw6Z7Fm57nU_z4JVGOEsG6eDtAP21cUOVXrxWYALeW9HrX6-76nPq8J7TGrLM53b7JkeDmqVrZqSg Aug 30 01:02:32.098370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:02:32.098370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:02:32.098370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:02:32.098370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:02:32.098370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:02:32.098370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:02:32.098370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: 92ca392a802e4d1eb0f3078a9c17b78d Aug 30 01:02:32.098370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-VolumesNegativeTest-1959927575 Aug 30 01:02:32.098370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:02:32.098370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:02:32.100516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_92ca392a802e4d1eb0f3078a9c17b78d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/92ca392a802e4d1eb0f3078a9c17b78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/92ca392a802e4d1eb0f3078a9c17b78d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/92ca392a802e4d1eb0f3078a9c17b78d"}]}] Aug 30 01:02:32.100516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-VolumesNegativeTest-1959927575 Aug 30 01:02:32.100516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: 92ca392a802e4d1eb0f3078a9c17b78d Aug 30 01:02:32.100516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-VolumesNegativeTest-1959927575 Aug 30 01:02:32.100516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-VolumesNegativeTest-1959927575-project Aug 30 01:02:32.100516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:02:32.100516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:02:32.100516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: f7ce3a318fcc408eaaab38f28e9751b8 Aug 30 01:02:32.100516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-VolumesNegativeTest-1959927575-project Aug 30 01:02:32.100516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Aug 30 01:02:32.100516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-758545837", "metadata": {"Type": "work"}}} Aug 30 01:02:32.100516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: Aug 30 01:02:32.100516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 01:02:32.101808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-758545837', 'metadata': {'Type': 'work'}}}} Aug 30 01:02:32.101808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:02:32.101808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:32.101808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 01:02:32.101808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 01:02:32.101808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 01:02:32.101808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise error Aug 30 01:02:32.101808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 30 01:02:32.101808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.101808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 01:02:32.101808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 01:02:32.101808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.101808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 01:02:32.101808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi '' Aug 30 01:02:32.101808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.101808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:32.101808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.101808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:32.101808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:32.101808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:32.101808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:02:32.101808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:02:32.104152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:02:32.104152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:02:32.104152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:02:32.104152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:02:32.104152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 01:02:32.104152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 01:02:32.104152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 01:02:32.104152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 01:02:32.104152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 01:02:32.104152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 01:02:32.104152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 01:02:32.104152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.104152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:32.104152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.104152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:32.104152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:32.104152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:32.104152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 01:02:32.104152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 01:02:32.105764 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 01:02:32.105764 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.105764 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-7a241b67-cb58-482c-a95b-4f29577ad7b8 tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:02:32.105764 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-7a241b67-cb58-482c-a95b-4f29577ad7b8 tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008998 Aug 30 01:02:32.105764 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 106/219] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Aug 30 01:02:32 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 01:02:32.111943 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0e769d23-5e1a-4464-a388-4dc17a9c055c tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] Calling method '.version_select at 0x7f0f528d6550>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:32.121405 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-216e49cf-1b9e-4d38-9f19-880d8629baf3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:32.130996 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-216e49cf-1b9e-4d38-9f19-880d8629baf3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.185051 Aug 30 01:02:32.131564 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 114/220] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:31 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:32.142597 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-0e769d23-5e1a-4464-a388-4dc17a9c055c tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] HTTP exception thrown: Volume tempest-invalid-1657937944 could not be found. Aug 30 01:02:32.144528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0e769d23-5e1a-4464-a388-4dc17a9c055c tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] Request method failure captured: Aug 30 01:02:32.144528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1657937944 HTTP/1.1 Aug 30 01:02:32.144528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:02:32.144528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:02:32.144528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:02:32.144528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:02:32.144528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:02:32.144528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:02:32.144528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:02:32.144528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:02:32.144528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWGnW1aiZ64tINnaceT693NMITt2PJH1Gr04ezFdiLBzFDrCM0dAB3JiUYhug0_zlIA45mYZD0maflw8aOaCo8cRsxcnCB532jVw6Z7Fm57nU_z4JVGOEsG6eDtAP21cUOVXrxWYALeW9HrX6-76nPq8J7TGrLM53b7JkeDmqVrZqSg Aug 30 01:02:32.144528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:02:32.144528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:02:32.144528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:02:32.144528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:02:32.144528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:02:32.144528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:02:32.144528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: 92ca392a802e4d1eb0f3078a9c17b78d Aug 30 01:02:32.144528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-VolumesNegativeTest-1959927575 Aug 30 01:02:32.144528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:02:32.144528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:02:32.146040 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_92ca392a802e4d1eb0f3078a9c17b78d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/92ca392a802e4d1eb0f3078a9c17b78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/92ca392a802e4d1eb0f3078a9c17b78d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/92ca392a802e4d1eb0f3078a9c17b78d"}]}] Aug 30 01:02:32.146040 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-VolumesNegativeTest-1959927575 Aug 30 01:02:32.146040 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: 92ca392a802e4d1eb0f3078a9c17b78d Aug 30 01:02:32.146040 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-VolumesNegativeTest-1959927575 Aug 30 01:02:32.146040 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-VolumesNegativeTest-1959927575-project Aug 30 01:02:32.146040 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:02:32.146040 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:02:32.146040 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: f7ce3a318fcc408eaaab38f28e9751b8 Aug 30 01:02:32.146040 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-VolumesNegativeTest-1959927575-project Aug 30 01:02:32.146040 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: Aug 30 01:02:32.146040 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Volume tempest-invalid-1657937944 could not be found. Aug 30 01:02:32.146040 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': 'tempest-invalid-1657937944'} Aug 30 01:02:32.146040 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:02:32.146731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:32.146731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:02:32.146731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:02:32.146731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 01:02:32.146731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 01:02:32.146731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 01:02:32.146731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 01:02:32.146731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 01:02:32.146731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 01:02:32.146731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 01:02:32.146731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 01:02:32.146731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:02:32.146731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:02:32.146731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:02:32.146731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:02:32.146731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1657937944 could not be found. (HTTP 404) (Request-ID: req-60a63e27-1730-4108-afdd-8967ddba8772) Aug 30 01:02:32.146731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.146731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:32.146731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.148294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:32.148294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 01:02:32.148294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 01:02:32.148294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:02:32.148294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:02:32.148294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:02:32.148294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:02:32.148294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:02:32.148294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:02:32.148294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:02:32.148294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:02:32.148294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 01:02:32.148294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 01:02:32.148294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 01:02:32.148294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 01:02:32.148294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 01:02:32.148294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 01:02:32.148294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 01:02:32.148294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 01:02:32.149604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:02:32.149604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:02:32.149604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:02:32.149604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:02:32.149604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1657937944 could not be found. Aug 30 01:02:32.149604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.149604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:32.149604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.149604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:32.149604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:32.149604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:32.149604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:02:32.149604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:02:32.149604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:02:32.149604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:02:32.149604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:02:32.149604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:02:32.149604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 01:02:32.149604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:02:32.149604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1657937944 could not be found. Aug 30 01:02:32.150754 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.150754 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:32.150754 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.150754 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:32.150754 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:32.150754 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:32.150754 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:02:32.150754 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:02:32.150754 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1657937944 could not be found. Aug 30 01:02:32.150754 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.150754 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0e769d23-5e1a-4464-a388-4dc17a9c055c tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] Returning 404 to user: Volume tempest-invalid-1657937944 could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:02:32.150754 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0e769d23-5e1a-4464-a388-4dc17a9c055c tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1657937944" status: 404 len: 99 microversion: 2.1 time: 0.037776 Aug 30 01:02:32.150754 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 107/221] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Aug 30 01:02:32 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1657937944 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 01:02:32.157805 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-0c12a8c3-68d3-4ea3-8a74-c4feb50a4352 tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004804 Aug 30 01:02:32.158305 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 115/222] 10.222.0.78 () {58 vars in 1140 bytes} [Tue Aug 30 01:02:32 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 01:02:32.167182 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-564a208b-9f56-46de-87c8-1a9bcb9885e0 tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003830 Aug 30 01:02:32.167788 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 108/223] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 30 01:02:32 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 01:02:32.176719 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-45ffe6db-b9be-4f2b-b97e-667cd4dd9725 tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] Calling method '.version_select at 0x7f0f528e4b80>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:32.206315 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-45ffe6db-b9be-4f2b-b97e-667cd4dd9725 tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] HTTP exception thrown: Volume 808021a0-2b17-4252-a8fa-952803686cf1 could not be found. Aug 30 01:02:32.208233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-45ffe6db-b9be-4f2b-b97e-667cd4dd9725 tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] Request method failure captured: Aug 30 01:02:32.208233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: DELETE /compute/v2.1/os-volumes/808021a0-2b17-4252-a8fa-952803686cf1 HTTP/1.1 Aug 30 01:02:32.208233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:02:32.208233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:02:32.208233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:02:32.208233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:02:32.208233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:02:32.208233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:02:32.208233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:02:32.208233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:02:32.208233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWGnW1aiZ64tINnaceT693NMITt2PJH1Gr04ezFdiLBzFDrCM0dAB3JiUYhug0_zlIA45mYZD0maflw8aOaCo8cRsxcnCB532jVw6Z7Fm57nU_z4JVGOEsG6eDtAP21cUOVXrxWYALeW9HrX6-76nPq8J7TGrLM53b7JkeDmqVrZqSg Aug 30 01:02:32.208233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:02:32.208233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:02:32.208233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:02:32.208233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:02:32.208233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:02:32.208233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:02:32.208233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: 92ca392a802e4d1eb0f3078a9c17b78d Aug 30 01:02:32.208233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-VolumesNegativeTest-1959927575 Aug 30 01:02:32.208233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:02:32.208233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:02:32.209704 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_92ca392a802e4d1eb0f3078a9c17b78d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/92ca392a802e4d1eb0f3078a9c17b78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/92ca392a802e4d1eb0f3078a9c17b78d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/92ca392a802e4d1eb0f3078a9c17b78d"}]}] Aug 30 01:02:32.209704 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-VolumesNegativeTest-1959927575 Aug 30 01:02:32.209704 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: 92ca392a802e4d1eb0f3078a9c17b78d Aug 30 01:02:32.209704 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-VolumesNegativeTest-1959927575 Aug 30 01:02:32.209704 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-VolumesNegativeTest-1959927575-project Aug 30 01:02:32.209704 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:02:32.209704 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:02:32.209704 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: f7ce3a318fcc408eaaab38f28e9751b8 Aug 30 01:02:32.209704 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-VolumesNegativeTest-1959927575-project Aug 30 01:02:32.209704 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: Aug 30 01:02:32.209704 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Volume 808021a0-2b17-4252-a8fa-952803686cf1 could not be found. Aug 30 01:02:32.209704 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': '808021a0-2b17-4252-a8fa-952803686cf1'} Aug 30 01:02:32.209704 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:02:32.210540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:32.210540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:02:32.210540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:02:32.210540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 01:02:32.210540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 01:02:32.210540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 01:02:32.210540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 01:02:32.210540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 01:02:32.210540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 01:02:32.210540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 01:02:32.210540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 01:02:32.210540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:02:32.210540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:02:32.210540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:02:32.210540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:02:32.210540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 808021a0-2b17-4252-a8fa-952803686cf1 could not be found. (HTTP 404) (Request-ID: req-4b75bffe-e681-4109-ba3f-0e799c6e2499) Aug 30 01:02:32.210540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.210540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:32.210540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.211836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:32.211836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 01:02:32.211836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 01:02:32.211836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:02:32.211836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:02:32.211836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:02:32.211836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:02:32.211836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:02:32.211836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:02:32.211836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:02:32.211836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:02:32.211836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 01:02:32.211836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 01:02:32.211836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 01:02:32.211836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 01:02:32.211836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 01:02:32.211836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 01:02:32.211836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 01:02:32.211836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 01:02:32.213028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:02:32.213028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:02:32.213028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:02:32.213028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:02:32.213028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 808021a0-2b17-4252-a8fa-952803686cf1 could not be found. Aug 30 01:02:32.213028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.213028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:32.213028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.213028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:32.213028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:32.213028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:32.213028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:02:32.213028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:02:32.213028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:02:32.213028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:02:32.213028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:02:32.213028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:02:32.213028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 01:02:32.213028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:02:32.214178 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 808021a0-2b17-4252-a8fa-952803686cf1 could not be found. Aug 30 01:02:32.214178 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.214178 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:32.214178 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.214178 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:32.214178 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:32.214178 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:32.214178 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:02:32.214178 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:02:32.214178 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 808021a0-2b17-4252-a8fa-952803686cf1 could not be found. Aug 30 01:02:32.214178 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.214178 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-45ffe6db-b9be-4f2b-b97e-667cd4dd9725 tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] Returning 404 to user: Volume 808021a0-2b17-4252-a8fa-952803686cf1 could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:02:32.214178 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-45ffe6db-b9be-4f2b-b97e-667cd4dd9725 tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/808021a0-2b17-4252-a8fa-952803686cf1" status: 404 len: 109 microversion: 2.1 time: 0.036660 Aug 30 01:02:32.214178 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 116/224] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 30 01:02:32 2022] DELETE /compute/v2.1/os-volumes/808021a0-2b17-4252-a8fa-952803686cf1 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:02:32.220258 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-fb13ab80-caa8-41ff-84c8-49cab1beee3f tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] Calling method '.version_select at 0x7f0f529cc4c0>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:32.255454 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-fb13ab80-caa8-41ff-84c8-49cab1beee3f tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] HTTP exception thrown: Volume 173d3530-8ff3-42ab-b238-0c6f4d3aae0e could not be found. Aug 30 01:02:32.257963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-fb13ab80-caa8-41ff-84c8-49cab1beee3f tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] Request method failure captured: Aug 30 01:02:32.257963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: GET /compute/v2.1/os-volumes/173d3530-8ff3-42ab-b238-0c6f4d3aae0e HTTP/1.1 Aug 30 01:02:32.257963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:02:32.257963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:02:32.257963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:02:32.257963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:02:32.257963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:02:32.257963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:02:32.257963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:02:32.257963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:02:32.257963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWGnW1aiZ64tINnaceT693NMITt2PJH1Gr04ezFdiLBzFDrCM0dAB3JiUYhug0_zlIA45mYZD0maflw8aOaCo8cRsxcnCB532jVw6Z7Fm57nU_z4JVGOEsG6eDtAP21cUOVXrxWYALeW9HrX6-76nPq8J7TGrLM53b7JkeDmqVrZqSg Aug 30 01:02:32.257963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:02:32.257963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:02:32.257963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:02:32.257963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:02:32.257963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:02:32.257963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:02:32.257963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: 92ca392a802e4d1eb0f3078a9c17b78d Aug 30 01:02:32.257963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-VolumesNegativeTest-1959927575 Aug 30 01:02:32.257963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:02:32.257963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:02:32.261237 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_92ca392a802e4d1eb0f3078a9c17b78d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/92ca392a802e4d1eb0f3078a9c17b78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/92ca392a802e4d1eb0f3078a9c17b78d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/92ca392a802e4d1eb0f3078a9c17b78d"}]}] Aug 30 01:02:32.261237 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-VolumesNegativeTest-1959927575 Aug 30 01:02:32.261237 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: 92ca392a802e4d1eb0f3078a9c17b78d Aug 30 01:02:32.261237 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-VolumesNegativeTest-1959927575 Aug 30 01:02:32.261237 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-VolumesNegativeTest-1959927575-project Aug 30 01:02:32.261237 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:02:32.261237 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:02:32.261237 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: f7ce3a318fcc408eaaab38f28e9751b8 Aug 30 01:02:32.261237 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-VolumesNegativeTest-1959927575-project Aug 30 01:02:32.261237 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: Aug 30 01:02:32.261237 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Volume 173d3530-8ff3-42ab-b238-0c6f4d3aae0e could not be found. Aug 30 01:02:32.261237 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': '173d3530-8ff3-42ab-b238-0c6f4d3aae0e'} Aug 30 01:02:32.261237 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:02:32.262208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:32.262208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:02:32.262208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:02:32.262208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:02:32.262208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:02:32.262208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:02:32.262208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:02:32.262208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:02:32.262208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:02:32.262208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:02:32.262208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:02:32.262208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:02:32.262208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:02:32.262208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:02:32.262208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:02:32.262208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 173d3530-8ff3-42ab-b238-0c6f4d3aae0e could not be found. (HTTP 404) (Request-ID: req-d57f67a5-1ff5-41c6-b8ee-1c97055738cf) Aug 30 01:02:32.262208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.262208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:32.262208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.263866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:32.263866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 01:02:32.263866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 01:02:32.263866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:02:32.263866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:02:32.263866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:02:32.263866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:02:32.263866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:02:32.263866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:02:32.263866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:02:32.263866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:02:32.263866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:02:32.263866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:02:32.263866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:02:32.263866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:02:32.263866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:02:32.263866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:02:32.263866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:02:32.263866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:02:32.265319 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:02:32.265319 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:02:32.265319 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:02:32.265319 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:02:32.265319 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 173d3530-8ff3-42ab-b238-0c6f4d3aae0e could not be found. Aug 30 01:02:32.265319 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.265319 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:32.265319 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.265319 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:32.265319 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:32.265319 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:32.265319 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:02:32.265319 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:02:32.265319 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:02:32.265319 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:02:32.265319 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:02:32.265319 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:02:32.265319 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 01:02:32.265319 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:02:32.266658 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 173d3530-8ff3-42ab-b238-0c6f4d3aae0e could not be found. Aug 30 01:02:32.266658 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.266658 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:32.266658 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.266658 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:32.266658 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:32.266658 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:32.266658 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:02:32.266658 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:02:32.266658 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 173d3530-8ff3-42ab-b238-0c6f4d3aae0e could not be found. Aug 30 01:02:32.266658 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:32.266658 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-fb13ab80-caa8-41ff-84c8-49cab1beee3f tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] Returning 404 to user: Volume 173d3530-8ff3-42ab-b238-0c6f4d3aae0e could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:02:32.266658 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-fb13ab80-caa8-41ff-84c8-49cab1beee3f tempest-VolumesNegativeTest-1959927575 tempest-VolumesNegativeTest-1959927575-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/173d3530-8ff3-42ab-b238-0c6f4d3aae0e" status: 404 len: 109 microversion: 2.1 time: 0.043596 Aug 30 01:02:32.266658 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 109/225] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 30 01:02:32 2022] GET /compute/v2.1/os-volumes/173d3530-8ff3-42ab-b238-0c6f4d3aae0e => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:02:33.084784 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-028e60dc-433f-4859-8717-407c204c3949 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:33.085533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-028e60dc-433f-4859-8717-407c204c3949 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: bc409b85-eeb9-4a88-9654-57063837c27e] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:33.097152 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-028e60dc-433f-4859-8717-407c204c3949 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:33.097696 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-028e60dc-433f-4859-8717-407c204c3949 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:33.098146 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-028e60dc-433f-4859-8717-407c204c3949 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:33.098887 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-028e60dc-433f-4859-8717-407c204c3949 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:33.099346 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-028e60dc-433f-4859-8717-407c204c3949 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:33.099769 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-028e60dc-433f-4859-8717-407c204c3949 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:33.120247 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:33.152214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-4db492cf-85d1-4450-b90b-7156190735ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:33.152824 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-4db492cf-85d1-4450-b90b-7156190735ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:33.164455 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4db492cf-85d1-4450-b90b-7156190735ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:33.165378 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4db492cf-85d1-4450-b90b-7156190735ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:33.166127 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4db492cf-85d1-4450-b90b-7156190735ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:33.167032 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4db492cf-85d1-4450-b90b-7156190735ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:33.167736 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4db492cf-85d1-4450-b90b-7156190735ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:33.168383 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4db492cf-85d1-4450-b90b-7156190735ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:33.308818 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-028e60dc-433f-4859-8717-407c204c3949 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:33.321777 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-028e60dc-433f-4859-8717-407c204c3949 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e" status: 200 len: 1313 microversion: 2.1 time: 0.241628 Aug 30 01:02:33.322893 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 117/226] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:33 2022] GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:33.377128 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-4db492cf-85d1-4450-b90b-7156190735ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:33.385063 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-4db492cf-85d1-4450-b90b-7156190735ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.236911 Aug 30 01:02:33.385644 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 110/227] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:33 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:34.344764 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-1cb29b9b-c514-45b9-9077-4f3cd7906828 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:34.345478 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-1cb29b9b-c514-45b9-9077-4f3cd7906828 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: bc409b85-eeb9-4a88-9654-57063837c27e] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:34.348758 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=2 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:34.349486 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=6 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:34.361635 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1cb29b9b-c514-45b9-9077-4f3cd7906828 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:34.367036 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1cb29b9b-c514-45b9-9077-4f3cd7906828 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:34.367566 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1cb29b9b-c514-45b9-9077-4f3cd7906828 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:34.368296 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1cb29b9b-c514-45b9-9077-4f3cd7906828 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:34.368839 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1cb29b9b-c514-45b9-9077-4f3cd7906828 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:34.369141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1cb29b9b-c514-45b9-9077-4f3cd7906828 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:34.407064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0c1d0540-e975-4f4b-80a1-b0770a9dba4f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:34.408193 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-0c1d0540-e975-4f4b-80a1-b0770a9dba4f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:34.418703 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=2 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:34.420255 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:34.422078 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0c1d0540-e975-4f4b-80a1-b0770a9dba4f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:34.422787 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0c1d0540-e975-4f4b-80a1-b0770a9dba4f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:34.423474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0c1d0540-e975-4f4b-80a1-b0770a9dba4f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:34.424392 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0c1d0540-e975-4f4b-80a1-b0770a9dba4f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:34.425107 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0c1d0540-e975-4f4b-80a1-b0770a9dba4f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:34.425798 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0c1d0540-e975-4f4b-80a1-b0770a9dba4f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:34.970851 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-1cb29b9b-c514-45b9-9077-4f3cd7906828 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:34.978679 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-1cb29b9b-c514-45b9-9077-4f3cd7906828 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e" status: 200 len: 1313 microversion: 2.1 time: 0.638981 Aug 30 01:02:34.979245 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 118/228] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:34 2022] GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e => generated 1313 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:34.998777 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-0c1d0540-e975-4f4b-80a1-b0770a9dba4f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:35.010327 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-c8a9eec6-b377-4c38-8645-42ab8cdb1843 req-ff21bb47-9c60-41fd-bd27-2c9fcdd3fa95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc409b85-eeb9-4a88-9654-57063837c27e", "name": "network-vif-plugged", "status": "completed", "tag": "d7d904e2-afb6-421e-9526-494607fa1712"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:35.010945 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0c1d0540-e975-4f4b-80a1-b0770a9dba4f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.606712 Aug 30 01:02:35.012897 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 111/229] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:34 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:35.023028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-c8a9eec6-b377-4c38-8645-42ab8cdb1843 req-ff21bb47-9c60-41fd-bd27-2c9fcdd3fa95 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:35.023771 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-c8a9eec6-b377-4c38-8645-42ab8cdb1843 req-ff21bb47-9c60-41fd-bd27-2c9fcdd3fa95 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:35.024375 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-c8a9eec6-b377-4c38-8645-42ab8cdb1843 req-ff21bb47-9c60-41fd-bd27-2c9fcdd3fa95 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:35.037153 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-c8a9eec6-b377-4c38-8645-42ab8cdb1843 req-ff21bb47-9c60-41fd-bd27-2c9fcdd3fa95 service nova] Creating event network-vif-plugged:d7d904e2-afb6-421e-9526-494607fa1712 for instance bc409b85-eeb9-4a88-9654-57063837c27e on hv-cinder-81514 Aug 30 01:02:35.044517 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-c8a9eec6-b377-4c38-8645-42ab8cdb1843 req-ff21bb47-9c60-41fd-bd27-2c9fcdd3fa95 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051573 Aug 30 01:02:35.049672 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 119/230] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:35.999896 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-edba7659-6fbb-4eb0-b223-d077e956731a tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:36.001376 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-edba7659-6fbb-4eb0-b223-d077e956731a tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: bc409b85-eeb9-4a88-9654-57063837c27e] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:36.008298 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-edba7659-6fbb-4eb0-b223-d077e956731a tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:36.009316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-edba7659-6fbb-4eb0-b223-d077e956731a tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:36.009909 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-edba7659-6fbb-4eb0-b223-d077e956731a tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:36.010785 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-edba7659-6fbb-4eb0-b223-d077e956731a tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:36.011522 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-edba7659-6fbb-4eb0-b223-d077e956731a tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:36.012101 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-edba7659-6fbb-4eb0-b223-d077e956731a tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:36.042430 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-073536db-34ef-464c-ac29-07c84522a530 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:36.042984 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-073536db-34ef-464c-ac29-07c84522a530 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:36.054435 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-073536db-34ef-464c-ac29-07c84522a530 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:36.054930 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-073536db-34ef-464c-ac29-07c84522a530 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:36.055375 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-073536db-34ef-464c-ac29-07c84522a530 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:36.056098 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-073536db-34ef-464c-ac29-07c84522a530 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:36.056572 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-073536db-34ef-464c-ac29-07c84522a530 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:36.057011 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-073536db-34ef-464c-ac29-07c84522a530 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:36.249485 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-edba7659-6fbb-4eb0-b223-d077e956731a tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:36.262049 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-edba7659-6fbb-4eb0-b223-d077e956731a tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e" status: 200 len: 1313 microversion: 2.1 time: 0.267053 Aug 30 01:02:36.265335 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 112/231] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:35 2022] GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:36.292688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-073536db-34ef-464c-ac29-07c84522a530 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:36.314366 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-073536db-34ef-464c-ac29-07c84522a530 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.277200 Aug 30 01:02:36.314953 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 120/232] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:36 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:37.287235 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e7956d6a-4214-4c53-ab5a-bdf100d1af51 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:37.295666 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e7956d6a-4214-4c53-ab5a-bdf100d1af51 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: bc409b85-eeb9-4a88-9654-57063837c27e] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:37.302377 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e7956d6a-4214-4c53-ab5a-bdf100d1af51 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:37.302901 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e7956d6a-4214-4c53-ab5a-bdf100d1af51 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:37.303286 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e7956d6a-4214-4c53-ab5a-bdf100d1af51 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:37.303983 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e7956d6a-4214-4c53-ab5a-bdf100d1af51 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:37.304429 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e7956d6a-4214-4c53-ab5a-bdf100d1af51 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:37.304876 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e7956d6a-4214-4c53-ab5a-bdf100d1af51 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:37.336305 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-841a3a9c-b299-440f-8eca-2ccf8af051f8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:37.338188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-841a3a9c-b299-440f-8eca-2ccf8af051f8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:37.346509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-841a3a9c-b299-440f-8eca-2ccf8af051f8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:37.347182 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-841a3a9c-b299-440f-8eca-2ccf8af051f8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:37.348463 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-841a3a9c-b299-440f-8eca-2ccf8af051f8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:37.349195 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-841a3a9c-b299-440f-8eca-2ccf8af051f8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:37.349646 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-841a3a9c-b299-440f-8eca-2ccf8af051f8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:37.350289 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-841a3a9c-b299-440f-8eca-2ccf8af051f8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:37.514293 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e7956d6a-4214-4c53-ab5a-bdf100d1af51 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:37.522876 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e7956d6a-4214-4c53-ab5a-bdf100d1af51 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e" status: 200 len: 1498 microversion: 2.1 time: 0.239570 Aug 30 01:02:37.523441 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 113/233] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:37 2022] GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e => generated 1498 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:37.568043 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-841a3a9c-b299-440f-8eca-2ccf8af051f8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:37.578350 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-841a3a9c-b299-440f-8eca-2ccf8af051f8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.246521 Aug 30 01:02:37.591745 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 121/234] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:37 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:37.749394 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-fc33c166-4022-4664-b403-2c8567d26b59 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-365482855", "imageRef": "d6c817b5-c41c-4210-a963-172386e2e582", "flavorRef": "452"}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:37.805607 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.network.neutron [None req-fc33c166-4022-4664-b403-2c8567d26b59 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] validate_networks() for None {{(pid=120631) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:02:38.051234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-a9c0f00a-3fc3-4b5e-ba5e-81c483a61bda tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:38.051722 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-a9c0f00a-3fc3-4b5e-ba5e-81c483a61bda tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: bc409b85-eeb9-4a88-9654-57063837c27e] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:38.057822 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a9c0f00a-3fc3-4b5e-ba5e-81c483a61bda tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:38.058538 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a9c0f00a-3fc3-4b5e-ba5e-81c483a61bda tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:38.058969 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a9c0f00a-3fc3-4b5e-ba5e-81c483a61bda tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:38.059829 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a9c0f00a-3fc3-4b5e-ba5e-81c483a61bda tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:38.060846 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a9c0f00a-3fc3-4b5e-ba5e-81c483a61bda tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:38.061289 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a9c0f00a-3fc3-4b5e-ba5e-81c483a61bda tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:38.088359 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-a9c0f00a-3fc3-4b5e-ba5e-81c483a61bda tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: bc409b85-eeb9-4a88-9654-57063837c27e] Going to try to terminate instance {{(pid=120630) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:02:38.129131 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-fc33c166-4022-4664-b403-2c8567d26b59 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Flavor limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:02:38.129815 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-fc33c166-4022-4664-b403-2c8567d26b59 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Image limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:02:38.130370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-fc33c166-4022-4664-b403-2c8567d26b59 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Flavor pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:02:38.131192 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-fc33c166-4022-4664-b403-2c8567d26b59 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Image pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:02:38.131618 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-fc33c166-4022-4664-b403-2c8567d26b59 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:02:38.142205 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fc33c166-4022-4664-b403-2c8567d26b59 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:38.142696 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fc33c166-4022-4664-b403-2c8567d26b59 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:38.143128 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fc33c166-4022-4664-b403-2c8567d26b59 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:38.144036 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fc33c166-4022-4664-b403-2c8567d26b59 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:38.144648 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fc33c166-4022-4664-b403-2c8567d26b59 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:38.145549 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fc33c166-4022-4664-b403-2c8567d26b59 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:38.165342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-fc33c166-4022-4664-b403-2c8567d26b59 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Getting quotas for project 8a8b8077287845c1815a82a8fdbf51b6. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:02:38.169597 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-fc33c166-4022-4664-b403-2c8567d26b59 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Getting quotas for user a2c60f3426484bc0baa3107ae3568724 and project 8a8b8077287845c1815a82a8fdbf51b6. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:02:38.177847 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-a9c0f00a-3fc3-4b5e-ba5e-81c483a61bda tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e" status: 204 len: 0 microversion: 2.1 time: 0.130071 Aug 30 01:02:38.178990 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 122/235] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:02:38 2022] DELETE /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 01:02:38.196739 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-fc33c166-4022-4664-b403-2c8567d26b59 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Going to run 1 instances... {{(pid=120631) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:02:38.197496 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-40b24d66-873b-4152-9108-39f6ddee6066 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:38.198488 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-40b24d66-873b-4152-9108-39f6ddee6066 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: bc409b85-eeb9-4a88-9654-57063837c27e] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:38.199171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-fc33c166-4022-4664-b403-2c8567d26b59 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] [instance: 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6c817b5-c41c-4210-a963-172386e2e582',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120631) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:02:38.205812 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-40b24d66-873b-4152-9108-39f6ddee6066 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:38.206303 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-40b24d66-873b-4152-9108-39f6ddee6066 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:38.206862 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-40b24d66-873b-4152-9108-39f6ddee6066 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:38.207561 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-40b24d66-873b-4152-9108-39f6ddee6066 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:38.208082 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-40b24d66-873b-4152-9108-39f6ddee6066 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:38.208506 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-40b24d66-873b-4152-9108-39f6ddee6066 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:38.264752 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-fc33c166-4022-4664-b403-2c8567d26b59 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517864 Aug 30 01:02:38.265714 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 114/236] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 30 01:02:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:02:38.277636 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-84f43871-f26c-462e-aeda-9a968abb63fc tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:38.278679 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-84f43871-f26c-462e-aeda-9a968abb63fc tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] [instance: 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:38.383516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-84f43871-f26c-462e-aeda-9a968abb63fc tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c60f3426484bc0baa3107ae3568724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8b8077287845c1815a82a8fdbf51b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:38.394451 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-84f43871-f26c-462e-aeda-9a968abb63fc tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] 10.222.0.78 "GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8" status: 200 len: 1214 microversion: 2.1 time: 0.120685 Aug 30 01:02:38.395488 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 115/237] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:38 2022] GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:38.420644 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-40b24d66-873b-4152-9108-39f6ddee6066 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:38.429505 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-40b24d66-873b-4152-9108-39f6ddee6066 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e" status: 200 len: 1504 microversion: 2.1 time: 0.245332 Aug 30 01:02:38.430851 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 123/238] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:38 2022] GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e => generated 1504 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:38.600495 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-b453c202-727f-4719-a3e6-d91451337851 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:38.601320 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-b453c202-727f-4719-a3e6-d91451337851 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:38.609830 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b453c202-727f-4719-a3e6-d91451337851 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:38.610557 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b453c202-727f-4719-a3e6-d91451337851 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:38.611296 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b453c202-727f-4719-a3e6-d91451337851 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:38.612278 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b453c202-727f-4719-a3e6-d91451337851 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:38.613025 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b453c202-727f-4719-a3e6-d91451337851 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:38.613662 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b453c202-727f-4719-a3e6-d91451337851 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:38.777257 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-b453c202-727f-4719-a3e6-d91451337851 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:38.786537 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-b453c202-727f-4719-a3e6-d91451337851 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.190898 Aug 30 01:02:38.787107 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 116/239] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:38 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:39.418899 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-96066aa0-6014-4a76-af91-07922f64ec24 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:39.421199 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-96066aa0-6014-4a76-af91-07922f64ec24 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] [instance: 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:39.427618 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-96066aa0-6014-4a76-af91-07922f64ec24 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:39.428269 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-96066aa0-6014-4a76-af91-07922f64ec24 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:39.428771 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-96066aa0-6014-4a76-af91-07922f64ec24 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:39.429569 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-96066aa0-6014-4a76-af91-07922f64ec24 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:39.430126 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-96066aa0-6014-4a76-af91-07922f64ec24 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:39.430625 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-96066aa0-6014-4a76-af91-07922f64ec24 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:39.452318 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3bfc1f72-98f7-41ef-84fd-8e104bada9a8 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:39.453610 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-3bfc1f72-98f7-41ef-84fd-8e104bada9a8 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: bc409b85-eeb9-4a88-9654-57063837c27e] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:39.459529 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3bfc1f72-98f7-41ef-84fd-8e104bada9a8 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:39.460226 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3bfc1f72-98f7-41ef-84fd-8e104bada9a8 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:39.460962 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3bfc1f72-98f7-41ef-84fd-8e104bada9a8 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:39.461562 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3bfc1f72-98f7-41ef-84fd-8e104bada9a8 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:39.462181 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3bfc1f72-98f7-41ef-84fd-8e104bada9a8 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:39.462605 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3bfc1f72-98f7-41ef-84fd-8e104bada9a8 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:39.503860 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-96066aa0-6014-4a76-af91-07922f64ec24 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c60f3426484bc0baa3107ae3568724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8b8077287845c1815a82a8fdbf51b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:39.512318 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-96066aa0-6014-4a76-af91-07922f64ec24 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] 10.222.0.78 "GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8" status: 200 len: 1218 microversion: 2.1 time: 0.097284 Aug 30 01:02:39.513106 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 124/240] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:39 2022] GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:39.604325 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3bfc1f72-98f7-41ef-84fd-8e104bada9a8 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:39.612192 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3bfc1f72-98f7-41ef-84fd-8e104bada9a8 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e" status: 200 len: 1504 microversion: 2.1 time: 0.164561 Aug 30 01:02:39.612765 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 117/241] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:39 2022] GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:39.807729 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-36e31e66-000b-4050-8950-aced10ba865d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:39.808332 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-36e31e66-000b-4050-8950-aced10ba865d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:39.815268 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-36e31e66-000b-4050-8950-aced10ba865d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:39.815776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-36e31e66-000b-4050-8950-aced10ba865d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:39.816209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-36e31e66-000b-4050-8950-aced10ba865d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:39.816894 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-36e31e66-000b-4050-8950-aced10ba865d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:39.817364 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-36e31e66-000b-4050-8950-aced10ba865d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:39.817781 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-36e31e66-000b-4050-8950-aced10ba865d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:39.966404 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-36e31e66-000b-4050-8950-aced10ba865d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:39.976638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-36e31e66-000b-4050-8950-aced10ba865d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.172532 Aug 30 01:02:39.990779 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 125/242] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:39 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:40.534433 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-287b399b-6a37-4f61-8d60-a26023950d28 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:40.535048 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-287b399b-6a37-4f61-8d60-a26023950d28 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] [instance: 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:40.541113 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-287b399b-6a37-4f61-8d60-a26023950d28 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:40.541543 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-287b399b-6a37-4f61-8d60-a26023950d28 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:40.541973 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-287b399b-6a37-4f61-8d60-a26023950d28 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:40.542882 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-287b399b-6a37-4f61-8d60-a26023950d28 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:40.543358 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-287b399b-6a37-4f61-8d60-a26023950d28 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:40.543762 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-287b399b-6a37-4f61-8d60-a26023950d28 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:40.612261 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-287b399b-6a37-4f61-8d60-a26023950d28 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c60f3426484bc0baa3107ae3568724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8b8077287845c1815a82a8fdbf51b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:40.620276 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-287b399b-6a37-4f61-8d60-a26023950d28 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] 10.222.0.78 "GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8" status: 200 len: 1266 microversion: 2.1 time: 0.089602 Aug 30 01:02:40.629829 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 118/243] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:40 2022] GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:40.632334 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-e9048d5f-52ba-49aa-b113-affeffd74347 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:40.632943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-e9048d5f-52ba-49aa-b113-affeffd74347 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: bc409b85-eeb9-4a88-9654-57063837c27e] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:40.639421 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e9048d5f-52ba-49aa-b113-affeffd74347 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:40.639898 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e9048d5f-52ba-49aa-b113-affeffd74347 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:40.640504 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e9048d5f-52ba-49aa-b113-affeffd74347 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:40.641440 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e9048d5f-52ba-49aa-b113-affeffd74347 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:40.641888 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e9048d5f-52ba-49aa-b113-affeffd74347 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:40.642305 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e9048d5f-52ba-49aa-b113-affeffd74347 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:40.750826 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-e9048d5f-52ba-49aa-b113-affeffd74347 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:40.766451 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-e9048d5f-52ba-49aa-b113-affeffd74347 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e" status: 200 len: 1462 microversion: 2.1 time: 0.137953 Aug 30 01:02:40.767715 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 126/244] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:40 2022] GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e => generated 1462 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:40.819483 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-9123189c-455a-4b49-9c6f-62ad933f3c78 req-558dc548-aec8-44dc-ab72-e803cbb1716f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc409b85-eeb9-4a88-9654-57063837c27e", "name": "network-vif-deleted", "tag": "d7d904e2-afb6-421e-9526-494607fa1712"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:40.832701 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-9123189c-455a-4b49-9c6f-62ad933f3c78 req-558dc548-aec8-44dc-ab72-e803cbb1716f service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:40.833541 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-9123189c-455a-4b49-9c6f-62ad933f3c78 req-558dc548-aec8-44dc-ab72-e803cbb1716f service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:40.834225 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-9123189c-455a-4b49-9c6f-62ad933f3c78 req-558dc548-aec8-44dc-ab72-e803cbb1716f service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:40.847599 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-9123189c-455a-4b49-9c6f-62ad933f3c78 req-558dc548-aec8-44dc-ab72-e803cbb1716f service nova] Creating event network-vif-deleted:d7d904e2-afb6-421e-9526-494607fa1712 for instance bc409b85-eeb9-4a88-9654-57063837c27e on hv-cinder-81514 Aug 30 01:02:40.854292 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-9123189c-455a-4b49-9c6f-62ad933f3c78 req-558dc548-aec8-44dc-ab72-e803cbb1716f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040428 Aug 30 01:02:40.855297 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 119/245] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:41.001511 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-b3fdb6ec-a698-407a-9e3a-47cfbcf74753 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:41.002787 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-b3fdb6ec-a698-407a-9e3a-47cfbcf74753 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:41.010368 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:41.016977 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b3fdb6ec-a698-407a-9e3a-47cfbcf74753 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:41.019656 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b3fdb6ec-a698-407a-9e3a-47cfbcf74753 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:41.020580 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b3fdb6ec-a698-407a-9e3a-47cfbcf74753 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:41.022313 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b3fdb6ec-a698-407a-9e3a-47cfbcf74753 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:41.022867 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b3fdb6ec-a698-407a-9e3a-47cfbcf74753 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:41.023366 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b3fdb6ec-a698-407a-9e3a-47cfbcf74753 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:41.202259 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-b3fdb6ec-a698-407a-9e3a-47cfbcf74753 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:41.228173 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-b3fdb6ec-a698-407a-9e3a-47cfbcf74753 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.232993 Aug 30 01:02:41.245568 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 127/246] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:40 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:41.646528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-39004ffb-4142-4685-9b71-8194e2daeb88 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:41.648448 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-39004ffb-4142-4685-9b71-8194e2daeb88 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] [instance: 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:41.659383 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-39004ffb-4142-4685-9b71-8194e2daeb88 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:41.660264 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-39004ffb-4142-4685-9b71-8194e2daeb88 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:41.660914 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-39004ffb-4142-4685-9b71-8194e2daeb88 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:41.662311 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-39004ffb-4142-4685-9b71-8194e2daeb88 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:41.663095 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-39004ffb-4142-4685-9b71-8194e2daeb88 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:41.663998 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-39004ffb-4142-4685-9b71-8194e2daeb88 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:41.786644 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-39004ffb-4142-4685-9b71-8194e2daeb88 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c60f3426484bc0baa3107ae3568724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8b8077287845c1815a82a8fdbf51b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:41.787995 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-122f9d49-b15c-491d-94d7-4dd61c83dc2b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:41.788656 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-122f9d49-b15c-491d-94d7-4dd61c83dc2b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: bc409b85-eeb9-4a88-9654-57063837c27e] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:41.797748 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-39004ffb-4142-4685-9b71-8194e2daeb88 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] 10.222.0.78 "GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8" status: 200 len: 1272 microversion: 2.1 time: 0.157366 Aug 30 01:02:41.798969 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-122f9d49-b15c-491d-94d7-4dd61c83dc2b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:41.799133 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 120/247] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:41 2022] GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:41.800712 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-122f9d49-b15c-491d-94d7-4dd61c83dc2b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:41.801193 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-122f9d49-b15c-491d-94d7-4dd61c83dc2b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:41.801905 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-122f9d49-b15c-491d-94d7-4dd61c83dc2b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:41.802356 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-122f9d49-b15c-491d-94d7-4dd61c83dc2b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:41.802770 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-122f9d49-b15c-491d-94d7-4dd61c83dc2b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:41.842372 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-122f9d49-b15c-491d-94d7-4dd61c83dc2b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:41.842910 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-122f9d49-b15c-491d-94d7-4dd61c83dc2b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:41.843282 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-122f9d49-b15c-491d-94d7-4dd61c83dc2b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:41.843718 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.objects.instance [None req-122f9d49-b15c-491d-94d7-4dd61c83dc2b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lazy-loading 'fault' on Instance uuid bc409b85-eeb9-4a88-9654-57063837c27e {{(pid=120630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:02:41.916135 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-122f9d49-b15c-491d-94d7-4dd61c83dc2b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed877b0a569455597dfbb8b98ae0bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c18e1da199c437b809a45aada0b0e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:41.927339 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-122f9d49-b15c-491d-94d7-4dd61c83dc2b tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e" status: 200 len: 1303 microversion: 2.1 time: 0.142946 Aug 30 01:02:41.928626 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 128/248] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:41 2022] GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e => generated 1303 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:42.262447 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3a44094c-dee7-411f-92ac-6a0be56f9d41 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:42.263073 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-3a44094c-dee7-411f-92ac-6a0be56f9d41 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:42.288767 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3a44094c-dee7-411f-92ac-6a0be56f9d41 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:42.289603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3a44094c-dee7-411f-92ac-6a0be56f9d41 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:42.291255 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3a44094c-dee7-411f-92ac-6a0be56f9d41 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:42.293292 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3a44094c-dee7-411f-92ac-6a0be56f9d41 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:42.295307 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3a44094c-dee7-411f-92ac-6a0be56f9d41 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:42.296916 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3a44094c-dee7-411f-92ac-6a0be56f9d41 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:42.616276 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3a44094c-dee7-411f-92ac-6a0be56f9d41 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:42.629154 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3a44094c-dee7-411f-92ac-6a0be56f9d41 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.367915 Aug 30 01:02:42.642828 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 121/249] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:42 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:42.820064 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-a50f4cb7-ddb5-411a-a629-c5dcd1d94a5d tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:42.820844 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-a50f4cb7-ddb5-411a-a629-c5dcd1d94a5d tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] [instance: 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:42.836667 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a50f4cb7-ddb5-411a-a629-c5dcd1d94a5d tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:42.837248 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a50f4cb7-ddb5-411a-a629-c5dcd1d94a5d tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:42.837628 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a50f4cb7-ddb5-411a-a629-c5dcd1d94a5d tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:42.838502 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a50f4cb7-ddb5-411a-a629-c5dcd1d94a5d tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:42.839095 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a50f4cb7-ddb5-411a-a629-c5dcd1d94a5d tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:42.839360 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a50f4cb7-ddb5-411a-a629-c5dcd1d94a5d tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:42.950506 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-fb58fbf9-2003-4662-9b63-6239bb8764d1 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:42.952107 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-fb58fbf9-2003-4662-9b63-6239bb8764d1 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] [instance: bc409b85-eeb9-4a88-9654-57063837c27e] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:42.965527 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fb58fbf9-2003-4662-9b63-6239bb8764d1 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:42.966188 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fb58fbf9-2003-4662-9b63-6239bb8764d1 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:42.967460 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fb58fbf9-2003-4662-9b63-6239bb8764d1 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:42.968476 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fb58fbf9-2003-4662-9b63-6239bb8764d1 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:42.969267 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fb58fbf9-2003-4662-9b63-6239bb8764d1 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:42.969973 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fb58fbf9-2003-4662-9b63-6239bb8764d1 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:42.987176 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-fb58fbf9-2003-4662-9b63-6239bb8764d1 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] HTTP exception thrown: Instance bc409b85-eeb9-4a88-9654-57063837c27e could not be found. Aug 30 01:02:42.988951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-fb58fbf9-2003-4662-9b63-6239bb8764d1 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Request method failure captured: Aug 30 01:02:42.988951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e HTTP/1.1 Aug 30 01:02:42.988951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:02:42.988951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:02:42.988951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:02:42.988951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:02:42.988951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:02:42.988951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:02:42.988951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:02:42.988951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:02:42.988951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWGDrX_mbaFwnTQUJ0fDEH3RSzAl19NgTcJn_WlLdgp-JGF0CSyanr76yJRWr5Mmc8mf9vkNO2aEhHCKSnAdLyv6D_iXihHAMDeA3S2gsb-OsLovdgCvpNhk1sMZYXvDMR4wx-HdOU9vNWIJgyqNbwp18zJ-MGlRbJU7lbH_YX6UqRs Aug 30 01:02:42.988951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:02:42.988951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:02:42.988951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:02:42.988951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:02:42.988951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:02:42.988951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:02:42.988951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: 2c18e1da199c437b809a45aada0b0e0e Aug 30 01:02:42.988951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-VolumesActionsTest-672031182 Aug 30 01:02:42.988951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:02:42.988951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:02:42.990341 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2c18e1da199c437b809a45aada0b0e0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2c18e1da199c437b809a45aada0b0e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2c18e1da199c437b809a45aada0b0e0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2c18e1da199c437b809a45aada0b0e0e"}]}] Aug 30 01:02:42.990341 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-VolumesActionsTest-672031182 Aug 30 01:02:42.990341 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: 2c18e1da199c437b809a45aada0b0e0e Aug 30 01:02:42.990341 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-VolumesActionsTest-672031182 Aug 30 01:02:42.990341 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-VolumesActionsTest-672031182-project Aug 30 01:02:42.990341 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:02:42.990341 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:02:42.990341 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: fed877b0a569455597dfbb8b98ae0bc0 Aug 30 01:02:42.990341 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-VolumesActionsTest-672031182-project Aug 30 01:02:42.990341 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:02:42.990341 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Instance bc409b85-eeb9-4a88-9654-57063837c27e could not be found. Aug 30 01:02:42.990341 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': 'bc409b85-eeb9-4a88-9654-57063837c27e'} Aug 30 01:02:42.991124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:02:42.991124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:42.991124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:02:42.991124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:02:42.991124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:02:42.991124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:02:42.991124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:02:42.991124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:02:42.991124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:02:42.991124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:02:42.991124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc409b85-eeb9-4a88-9654-57063837c27e could not be found. Aug 30 01:02:42.991124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:42.991124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:42.991124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:42.991124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:42.991124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:42.991124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:42.991124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:02:42.991124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:02:42.991124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:02:42.992871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:02:42.992871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:02:42.992871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:02:42.992871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:02:42.992871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:02:42.992871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:02:42.992871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:02:42.992871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc409b85-eeb9-4a88-9654-57063837c27e could not be found. Aug 30 01:02:42.992871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:42.992871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:42.992871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:42.992871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:42.992871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:42.992871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:42.992871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:02:42.992871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:02:42.992871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc409b85-eeb9-4a88-9654-57063837c27e could not be found. Aug 30 01:02:42.992871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:02:42.994051 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-fb58fbf9-2003-4662-9b63-6239bb8764d1 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] Returning 404 to user: Instance bc409b85-eeb9-4a88-9654-57063837c27e could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:02:42.994051 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-fb58fbf9-2003-4662-9b63-6239bb8764d1 tempest-VolumesActionsTest-672031182 tempest-VolumesActionsTest-672031182-project] 10.222.0.78 "GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e" status: 404 len: 111 microversion: 2.1 time: 0.043718 Aug 30 01:02:42.994312 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 122/250] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:42 2022] GET /compute/v2.1/servers/bc409b85-eeb9-4a88-9654-57063837c27e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:02:43.009598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-432ec79b-3189-4c51-9e48-493bf137cc44 req-124c3fa7-d603-4dc0-851c-a059726f43e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a7f7efc-a0a0-4ad5-9627-107cac69b0c8", "tag": "3986239f-dade-4de4-a3ba-9ecd2f4b9183"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:43.022205 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-432ec79b-3189-4c51-9e48-493bf137cc44 req-124c3fa7-d603-4dc0-851c-a059726f43e1 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:43.022688 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-432ec79b-3189-4c51-9e48-493bf137cc44 req-124c3fa7-d603-4dc0-851c-a059726f43e1 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:43.023617 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-432ec79b-3189-4c51-9e48-493bf137cc44 req-124c3fa7-d603-4dc0-851c-a059726f43e1 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:43.045520 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-432ec79b-3189-4c51-9e48-493bf137cc44 req-124c3fa7-d603-4dc0-851c-a059726f43e1 service nova] Creating event network-changed:3986239f-dade-4de4-a3ba-9ecd2f4b9183 for instance 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 on hv-cinder-81514 Aug 30 01:02:43.054998 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-432ec79b-3189-4c51-9e48-493bf137cc44 req-124c3fa7-d603-4dc0-851c-a059726f43e1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049147 Aug 30 01:02:43.056019 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 123/251] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:43.150264 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-a50f4cb7-ddb5-411a-a629-c5dcd1d94a5d tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c60f3426484bc0baa3107ae3568724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8b8077287845c1815a82a8fdbf51b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:43.159002 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-a50f4cb7-ddb5-411a-a629-c5dcd1d94a5d tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] 10.222.0.78 "GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8" status: 200 len: 1314 microversion: 2.1 time: 0.343312 Aug 30 01:02:43.174013 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 129/252] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:42 2022] GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:43.660436 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-c9ad068e-5104-41f0-824b-5bce16812e31 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:43.661176 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-c9ad068e-5104-41f0-824b-5bce16812e31 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:43.670687 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c9ad068e-5104-41f0-824b-5bce16812e31 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:43.671364 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c9ad068e-5104-41f0-824b-5bce16812e31 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:43.671969 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c9ad068e-5104-41f0-824b-5bce16812e31 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:43.673049 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c9ad068e-5104-41f0-824b-5bce16812e31 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:43.673702 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c9ad068e-5104-41f0-824b-5bce16812e31 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:43.674287 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c9ad068e-5104-41f0-824b-5bce16812e31 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:43.934002 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-c9ad068e-5104-41f0-824b-5bce16812e31 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:43.942573 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-c9ad068e-5104-41f0-824b-5bce16812e31 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.286320 Aug 30 01:02:43.943143 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 124/253] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:43 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:44.180548 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8ce648d0-8c46-4938-a3b3-a8309f8aa0f4 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:44.181299 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8ce648d0-8c46-4938-a3b3-a8309f8aa0f4 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] [instance: 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:44.189233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ce648d0-8c46-4938-a3b3-a8309f8aa0f4 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:44.189798 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ce648d0-8c46-4938-a3b3-a8309f8aa0f4 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:44.190237 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ce648d0-8c46-4938-a3b3-a8309f8aa0f4 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:44.191180 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ce648d0-8c46-4938-a3b3-a8309f8aa0f4 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:44.191805 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ce648d0-8c46-4938-a3b3-a8309f8aa0f4 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:44.192520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ce648d0-8c46-4938-a3b3-a8309f8aa0f4 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:44.333289 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8ce648d0-8c46-4938-a3b3-a8309f8aa0f4 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c60f3426484bc0baa3107ae3568724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8b8077287845c1815a82a8fdbf51b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:44.341020 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8ce648d0-8c46-4938-a3b3-a8309f8aa0f4 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] 10.222.0.78 "GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8" status: 200 len: 1314 microversion: 2.1 time: 0.164396 Aug 30 01:02:44.342369 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 130/254] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:44 2022] GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:44.963837 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-1575d7dd-935f-4c0c-8b5f-e62a441aeac5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:44.964382 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-1575d7dd-935f-4c0c-8b5f-e62a441aeac5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:44.970928 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1575d7dd-935f-4c0c-8b5f-e62a441aeac5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:44.971412 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1575d7dd-935f-4c0c-8b5f-e62a441aeac5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:44.971852 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1575d7dd-935f-4c0c-8b5f-e62a441aeac5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:44.972546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1575d7dd-935f-4c0c-8b5f-e62a441aeac5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:44.973006 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1575d7dd-935f-4c0c-8b5f-e62a441aeac5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:44.973460 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1575d7dd-935f-4c0c-8b5f-e62a441aeac5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:45.100077 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-1575d7dd-935f-4c0c-8b5f-e62a441aeac5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:45.108413 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-1575d7dd-935f-4c0c-8b5f-e62a441aeac5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.148523 Aug 30 01:02:45.109195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 125/255] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:44 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:45.362396 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-a089d4d6-b92d-4f4f-8684-34959003079f tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:45.363005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-a089d4d6-b92d-4f4f-8684-34959003079f tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] [instance: 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:45.369615 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a089d4d6-b92d-4f4f-8684-34959003079f tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:45.370095 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a089d4d6-b92d-4f4f-8684-34959003079f tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:45.370529 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a089d4d6-b92d-4f4f-8684-34959003079f tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:45.371213 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a089d4d6-b92d-4f4f-8684-34959003079f tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:45.371666 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a089d4d6-b92d-4f4f-8684-34959003079f tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:45.372087 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a089d4d6-b92d-4f4f-8684-34959003079f tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:45.504998 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-a089d4d6-b92d-4f4f-8684-34959003079f tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c60f3426484bc0baa3107ae3568724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8b8077287845c1815a82a8fdbf51b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:45.512629 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-a089d4d6-b92d-4f4f-8684-34959003079f tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] 10.222.0.78 "GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8" status: 200 len: 1314 microversion: 2.1 time: 0.154044 Aug 30 01:02:45.513841 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 131/256] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:45 2022] GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:46.133017 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-ef06a2f0-4261-41a3-be34-1f5ebd1862d0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:46.133652 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-ef06a2f0-4261-41a3-be34-1f5ebd1862d0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:46.140043 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ef06a2f0-4261-41a3-be34-1f5ebd1862d0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:46.140528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ef06a2f0-4261-41a3-be34-1f5ebd1862d0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:46.140966 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ef06a2f0-4261-41a3-be34-1f5ebd1862d0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:46.141687 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ef06a2f0-4261-41a3-be34-1f5ebd1862d0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:46.142139 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ef06a2f0-4261-41a3-be34-1f5ebd1862d0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:46.142562 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ef06a2f0-4261-41a3-be34-1f5ebd1862d0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:46.271245 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-ef06a2f0-4261-41a3-be34-1f5ebd1862d0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:46.278960 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-ef06a2f0-4261-41a3-be34-1f5ebd1862d0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.149764 Aug 30 01:02:46.279517 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 126/257] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:46 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:46.534029 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-e1c2235b-ef61-416d-92da-3a0826443ea0 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:46.534539 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-e1c2235b-ef61-416d-92da-3a0826443ea0 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] [instance: 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:46.540942 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e1c2235b-ef61-416d-92da-3a0826443ea0 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:46.541455 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e1c2235b-ef61-416d-92da-3a0826443ea0 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:46.541884 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e1c2235b-ef61-416d-92da-3a0826443ea0 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:46.542563 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e1c2235b-ef61-416d-92da-3a0826443ea0 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:46.543013 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e1c2235b-ef61-416d-92da-3a0826443ea0 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:46.543433 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e1c2235b-ef61-416d-92da-3a0826443ea0 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:46.676489 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-e1c2235b-ef61-416d-92da-3a0826443ea0 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c60f3426484bc0baa3107ae3568724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8b8077287845c1815a82a8fdbf51b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:46.679896 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:46.684644 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-e1c2235b-ef61-416d-92da-3a0826443ea0 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] 10.222.0.78 "GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8" status: 200 len: 1314 microversion: 2.1 time: 0.154526 Aug 30 01:02:46.686051 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 132/258] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:46 2022] GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:47.301370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-57bf83f6-b278-4d07-8800-18ed5d48f6e9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:47.301994 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-57bf83f6-b278-4d07-8800-18ed5d48f6e9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:47.308127 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-57bf83f6-b278-4d07-8800-18ed5d48f6e9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:47.308723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-57bf83f6-b278-4d07-8800-18ed5d48f6e9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:47.309048 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-57bf83f6-b278-4d07-8800-18ed5d48f6e9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:47.309800 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-57bf83f6-b278-4d07-8800-18ed5d48f6e9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:47.311179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-57bf83f6-b278-4d07-8800-18ed5d48f6e9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:47.311367 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-57bf83f6-b278-4d07-8800-18ed5d48f6e9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:47.444649 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-57bf83f6-b278-4d07-8800-18ed5d48f6e9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:47.452404 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-57bf83f6-b278-4d07-8800-18ed5d48f6e9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.155277 Aug 30 01:02:47.452965 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 127/259] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:47 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:47.706882 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-be8b6251-c522-4cac-be9f-9fb43cc75f34 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:47.707532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-be8b6251-c522-4cac-be9f-9fb43cc75f34 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] [instance: 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:47.714401 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-be8b6251-c522-4cac-be9f-9fb43cc75f34 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:47.714884 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-be8b6251-c522-4cac-be9f-9fb43cc75f34 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:47.715337 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-be8b6251-c522-4cac-be9f-9fb43cc75f34 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:47.716036 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-be8b6251-c522-4cac-be9f-9fb43cc75f34 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:47.717412 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-be8b6251-c522-4cac-be9f-9fb43cc75f34 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:47.718086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-be8b6251-c522-4cac-be9f-9fb43cc75f34 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:47.927306 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-be8b6251-c522-4cac-be9f-9fb43cc75f34 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c60f3426484bc0baa3107ae3568724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8b8077287845c1815a82a8fdbf51b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:47.935334 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-be8b6251-c522-4cac-be9f-9fb43cc75f34 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] 10.222.0.78 "GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8" status: 200 len: 1314 microversion: 2.1 time: 0.232504 Aug 30 01:02:47.935925 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 133/260] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:47 2022] GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:48.473817 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-6ad51604-857d-49d6-8ef2-626b46e1edd2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:48.474513 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-6ad51604-857d-49d6-8ef2-626b46e1edd2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:48.476882 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=2 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:48.477648 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=8 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:48.484853 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ad51604-857d-49d6-8ef2-626b46e1edd2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:48.485342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ad51604-857d-49d6-8ef2-626b46e1edd2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:48.485784 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ad51604-857d-49d6-8ef2-626b46e1edd2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:48.486686 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ad51604-857d-49d6-8ef2-626b46e1edd2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:48.487152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ad51604-857d-49d6-8ef2-626b46e1edd2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:48.487971 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ad51604-857d-49d6-8ef2-626b46e1edd2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:48.699166 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6ad51604-857d-49d6-8ef2-626b46e1edd2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:48.709655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-6ad51604-857d-49d6-8ef2-626b46e1edd2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.239652 Aug 30 01:02:48.710235 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 128/261] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:48 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:48.956607 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-37af8330-d9a7-46de-914d-1b8162b50756 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:48.957521 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-37af8330-d9a7-46de-914d-1b8162b50756 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] [instance: 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:48.965537 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-37af8330-d9a7-46de-914d-1b8162b50756 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:48.966027 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-37af8330-d9a7-46de-914d-1b8162b50756 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:48.967212 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-37af8330-d9a7-46de-914d-1b8162b50756 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:48.967918 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-37af8330-d9a7-46de-914d-1b8162b50756 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:48.968372 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-37af8330-d9a7-46de-914d-1b8162b50756 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:48.968802 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-37af8330-d9a7-46de-914d-1b8162b50756 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:49.116752 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-37af8330-d9a7-46de-914d-1b8162b50756 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c60f3426484bc0baa3107ae3568724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8b8077287845c1815a82a8fdbf51b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:49.125650 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-37af8330-d9a7-46de-914d-1b8162b50756 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] 10.222.0.78 "GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8" status: 200 len: 1314 microversion: 2.1 time: 0.172906 Aug 30 01:02:49.126220 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 134/262] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:48 2022] GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:49.735472 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-cdb2449e-9067-4154-b64a-3f5905e5ed34 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:49.742534 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-cdb2449e-9067-4154-b64a-3f5905e5ed34 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:49.754750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cdb2449e-9067-4154-b64a-3f5905e5ed34 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:49.755269 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cdb2449e-9067-4154-b64a-3f5905e5ed34 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:49.755910 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cdb2449e-9067-4154-b64a-3f5905e5ed34 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:49.756810 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cdb2449e-9067-4154-b64a-3f5905e5ed34 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:49.757464 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cdb2449e-9067-4154-b64a-3f5905e5ed34 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:49.758125 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cdb2449e-9067-4154-b64a-3f5905e5ed34 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:49.923835 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-cdb2449e-9067-4154-b64a-3f5905e5ed34 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:49.927526 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=100 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:49.932778 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-cdb2449e-9067-4154-b64a-3f5905e5ed34 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.205788 Aug 30 01:02:49.934696 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 129/263] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:49 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:50.149854 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f31814d2-791a-4c8e-9fdf-f157ba05e97c tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:50.150465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-f31814d2-791a-4c8e-9fdf-f157ba05e97c tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] [instance: 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:50.168426 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f31814d2-791a-4c8e-9fdf-f157ba05e97c tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:50.169219 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f31814d2-791a-4c8e-9fdf-f157ba05e97c tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:50.170232 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f31814d2-791a-4c8e-9fdf-f157ba05e97c tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:50.170935 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f31814d2-791a-4c8e-9fdf-f157ba05e97c tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:50.171395 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f31814d2-791a-4c8e-9fdf-f157ba05e97c tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:50.171823 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f31814d2-791a-4c8e-9fdf-f157ba05e97c tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:50.338019 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-f31814d2-791a-4c8e-9fdf-f157ba05e97c tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c60f3426484bc0baa3107ae3568724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8b8077287845c1815a82a8fdbf51b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:50.349401 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-f31814d2-791a-4c8e-9fdf-f157ba05e97c tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] 10.222.0.78 "GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8" status: 200 len: 1314 microversion: 2.1 time: 0.203164 Aug 30 01:02:50.362830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 135/264] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:50 2022] GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:50.957206 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-b7c10e88-2c84-48c4-9d35-4a922a68f1b5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:50.957899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-b7c10e88-2c84-48c4-9d35-4a922a68f1b5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:50.964859 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b7c10e88-2c84-48c4-9d35-4a922a68f1b5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:50.965403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b7c10e88-2c84-48c4-9d35-4a922a68f1b5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:50.965929 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b7c10e88-2c84-48c4-9d35-4a922a68f1b5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:50.968119 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b7c10e88-2c84-48c4-9d35-4a922a68f1b5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:50.968600 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b7c10e88-2c84-48c4-9d35-4a922a68f1b5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:50.969111 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b7c10e88-2c84-48c4-9d35-4a922a68f1b5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:51.120113 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-b7c10e88-2c84-48c4-9d35-4a922a68f1b5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:51.131348 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-b7c10e88-2c84-48c4-9d35-4a922a68f1b5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.178009 Aug 30 01:02:51.148208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 130/265] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:50 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:51.370033 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-46176c76-112b-4fb4-b694-19c83304c8b5 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:51.370804 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-46176c76-112b-4fb4-b694-19c83304c8b5 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] [instance: 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:51.378281 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-46176c76-112b-4fb4-b694-19c83304c8b5 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:51.378853 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-46176c76-112b-4fb4-b694-19c83304c8b5 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:51.379510 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-46176c76-112b-4fb4-b694-19c83304c8b5 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:51.380224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-46176c76-112b-4fb4-b694-19c83304c8b5 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:51.380675 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-46176c76-112b-4fb4-b694-19c83304c8b5 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:51.381333 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-46176c76-112b-4fb4-b694-19c83304c8b5 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:51.523241 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-46176c76-112b-4fb4-b694-19c83304c8b5 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c60f3426484bc0baa3107ae3568724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8b8077287845c1815a82a8fdbf51b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:51.532928 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-46176c76-112b-4fb4-b694-19c83304c8b5 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] 10.222.0.78 "GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8" status: 200 len: 1314 microversion: 2.1 time: 0.166638 Aug 30 01:02:51.538852 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 136/266] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:51 2022] GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:52.156632 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-cee16ced-b993-4f89-ab69-0e2a06d7d7ae tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:52.157346 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-cee16ced-b993-4f89-ab69-0e2a06d7d7ae tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:52.163307 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cee16ced-b993-4f89-ab69-0e2a06d7d7ae tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:52.163794 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cee16ced-b993-4f89-ab69-0e2a06d7d7ae tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:52.164232 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cee16ced-b993-4f89-ab69-0e2a06d7d7ae tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:52.164930 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cee16ced-b993-4f89-ab69-0e2a06d7d7ae tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:52.166225 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cee16ced-b993-4f89-ab69-0e2a06d7d7ae tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:52.166225 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cee16ced-b993-4f89-ab69-0e2a06d7d7ae tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:52.371330 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-cee16ced-b993-4f89-ab69-0e2a06d7d7ae tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:52.380191 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-cee16ced-b993-4f89-ab69-0e2a06d7d7ae tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.228148 Aug 30 01:02:52.380917 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 131/267] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:52 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:52.554517 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-340074fe-90df-431c-aaf9-ab75b0ac4af3 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:52.555304 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-340074fe-90df-431c-aaf9-ab75b0ac4af3 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] [instance: 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:52.568202 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-340074fe-90df-431c-aaf9-ab75b0ac4af3 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:52.569106 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-340074fe-90df-431c-aaf9-ab75b0ac4af3 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:52.569772 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-340074fe-90df-431c-aaf9-ab75b0ac4af3 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:52.570744 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-340074fe-90df-431c-aaf9-ab75b0ac4af3 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:52.571415 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-340074fe-90df-431c-aaf9-ab75b0ac4af3 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:52.572191 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-340074fe-90df-431c-aaf9-ab75b0ac4af3 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:52.733652 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-340074fe-90df-431c-aaf9-ab75b0ac4af3 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c60f3426484bc0baa3107ae3568724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8b8077287845c1815a82a8fdbf51b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:52.741989 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-340074fe-90df-431c-aaf9-ab75b0ac4af3 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] 10.222.0.78 "GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8" status: 200 len: 1314 microversion: 2.1 time: 0.191301 Aug 30 01:02:52.743206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 137/268] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:52 2022] GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:52.744556 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-cb994429-b611-4392-b206-5cd2ce105433 req-4118db50-d4f3-42f6-87af-34a74d25f5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a7f7efc-a0a0-4ad5-9627-107cac69b0c8", "name": "network-vif-plugged", "status": "completed", "tag": "3986239f-dade-4de4-a3ba-9ecd2f4b9183"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:52.761792 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-cb994429-b611-4392-b206-5cd2ce105433 req-4118db50-d4f3-42f6-87af-34a74d25f5d1 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:52.762862 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-cb994429-b611-4392-b206-5cd2ce105433 req-4118db50-d4f3-42f6-87af-34a74d25f5d1 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:52.764637 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-cb994429-b611-4392-b206-5cd2ce105433 req-4118db50-d4f3-42f6-87af-34a74d25f5d1 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:52.781954 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-cb994429-b611-4392-b206-5cd2ce105433 req-4118db50-d4f3-42f6-87af-34a74d25f5d1 service nova] Creating event network-vif-plugged:3986239f-dade-4de4-a3ba-9ecd2f4b9183 for instance 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 on hv-cinder-81514 Aug 30 01:02:52.789785 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-cb994429-b611-4392-b206-5cd2ce105433 req-4118db50-d4f3-42f6-87af-34a74d25f5d1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050362 Aug 30 01:02:52.790836 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 132/269] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:02:53.400520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4424f34e-9c6b-4617-9ebd-18dc6a47ada7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:53.401209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-4424f34e-9c6b-4617-9ebd-18dc6a47ada7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:53.408402 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4424f34e-9c6b-4617-9ebd-18dc6a47ada7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:53.408919 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4424f34e-9c6b-4617-9ebd-18dc6a47ada7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:53.409386 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4424f34e-9c6b-4617-9ebd-18dc6a47ada7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:53.410125 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4424f34e-9c6b-4617-9ebd-18dc6a47ada7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:53.410579 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4424f34e-9c6b-4617-9ebd-18dc6a47ada7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:53.411185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4424f34e-9c6b-4617-9ebd-18dc6a47ada7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:53.558374 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-4424f34e-9c6b-4617-9ebd-18dc6a47ada7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:53.567072 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-4424f34e-9c6b-4617-9ebd-18dc6a47ada7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.170999 Aug 30 01:02:53.578728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 138/270] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:53 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:53.768014 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-12d15956-4ea5-4323-afba-630b8a2dde98 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:53.769535 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-12d15956-4ea5-4323-afba-630b8a2dde98 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] [instance: 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:53.776225 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-12d15956-4ea5-4323-afba-630b8a2dde98 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:53.776783 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-12d15956-4ea5-4323-afba-630b8a2dde98 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:53.777352 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-12d15956-4ea5-4323-afba-630b8a2dde98 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:53.778291 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-12d15956-4ea5-4323-afba-630b8a2dde98 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:53.780284 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-12d15956-4ea5-4323-afba-630b8a2dde98 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:53.780796 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-12d15956-4ea5-4323-afba-630b8a2dde98 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:53.934308 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-12d15956-4ea5-4323-afba-630b8a2dde98 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c60f3426484bc0baa3107ae3568724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8b8077287845c1815a82a8fdbf51b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:53.953152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-12d15956-4ea5-4323-afba-630b8a2dde98 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] 10.222.0.78 "GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8" status: 200 len: 1314 microversion: 2.1 time: 0.189980 Aug 30 01:02:53.953870 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 133/271] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:53 2022] GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:54.587810 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-283274d1-90cb-49bd-8e5f-2454e911bada tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:54.588399 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-283274d1-90cb-49bd-8e5f-2454e911bada tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:54.595566 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-283274d1-90cb-49bd-8e5f-2454e911bada tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:54.596272 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-283274d1-90cb-49bd-8e5f-2454e911bada tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:54.596706 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-283274d1-90cb-49bd-8e5f-2454e911bada tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:54.597606 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-283274d1-90cb-49bd-8e5f-2454e911bada tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:54.598063 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-283274d1-90cb-49bd-8e5f-2454e911bada tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:54.598504 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-283274d1-90cb-49bd-8e5f-2454e911bada tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:54.753179 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-283274d1-90cb-49bd-8e5f-2454e911bada tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:54.761351 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-283274d1-90cb-49bd-8e5f-2454e911bada tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.177256 Aug 30 01:02:54.762241 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 139/272] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:54 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:54.976815 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-40e82bd9-56cf-49f4-b7e3-46ccda79d576 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:54.977870 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-40e82bd9-56cf-49f4-b7e3-46ccda79d576 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] [instance: 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:54.986866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-40e82bd9-56cf-49f4-b7e3-46ccda79d576 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:54.987748 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-40e82bd9-56cf-49f4-b7e3-46ccda79d576 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:54.988531 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-40e82bd9-56cf-49f4-b7e3-46ccda79d576 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:54.989470 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-40e82bd9-56cf-49f4-b7e3-46ccda79d576 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:54.989977 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-40e82bd9-56cf-49f4-b7e3-46ccda79d576 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:54.990409 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-40e82bd9-56cf-49f4-b7e3-46ccda79d576 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:55.148338 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-40e82bd9-56cf-49f4-b7e3-46ccda79d576 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c60f3426484bc0baa3107ae3568724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8b8077287845c1815a82a8fdbf51b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:55.161032 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-40e82bd9-56cf-49f4-b7e3-46ccda79d576 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] 10.222.0.78 "GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8" status: 200 len: 1463 microversion: 2.1 time: 0.189974 Aug 30 01:02:55.161874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 134/273] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:54 2022] GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 => generated 1463 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:55.209949 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-953020f9-f5d6-460e-8519-c2ed05e06082 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:55.210558 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-953020f9-f5d6-460e-8519-c2ed05e06082 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] [instance: 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:55.217270 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-953020f9-f5d6-460e-8519-c2ed05e06082 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:55.218225 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-953020f9-f5d6-460e-8519-c2ed05e06082 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:55.218754 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-953020f9-f5d6-460e-8519-c2ed05e06082 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:55.219697 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-953020f9-f5d6-460e-8519-c2ed05e06082 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:55.220226 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-953020f9-f5d6-460e-8519-c2ed05e06082 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:55.220866 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-953020f9-f5d6-460e-8519-c2ed05e06082 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:55.262584 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-953020f9-f5d6-460e-8519-c2ed05e06082 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] [instance: 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8] Going to try to terminate instance {{(pid=120630) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:02:55.365651 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-953020f9-f5d6-460e-8519-c2ed05e06082 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8" status: 204 len: 0 microversion: 2.1 time: 0.159982 Aug 30 01:02:55.366225 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 140/274] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:02:55 2022] DELETE /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:02:55.377134 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-6257b62c-a090-40d6-a956-361acefcf377 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:55.378069 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-6257b62c-a090-40d6-a956-361acefcf377 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] [instance: 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:55.392548 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6257b62c-a090-40d6-a956-361acefcf377 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:55.394587 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6257b62c-a090-40d6-a956-361acefcf377 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:55.395217 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6257b62c-a090-40d6-a956-361acefcf377 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:55.396352 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6257b62c-a090-40d6-a956-361acefcf377 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:55.396827 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6257b62c-a090-40d6-a956-361acefcf377 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:55.397512 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6257b62c-a090-40d6-a956-361acefcf377 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:55.578217 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6257b62c-a090-40d6-a956-361acefcf377 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c60f3426484bc0baa3107ae3568724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8b8077287845c1815a82a8fdbf51b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:55.588412 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-6257b62c-a090-40d6-a956-361acefcf377 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] 10.222.0.78 "GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8" status: 200 len: 1469 microversion: 2.1 time: 0.217599 Aug 30 01:02:55.589382 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 135/275] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:55 2022] GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 => generated 1469 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:55.784934 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-cdac29bf-a8e2-4807-899c-ad9a32f8f967 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:55.785810 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-cdac29bf-a8e2-4807-899c-ad9a32f8f967 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:55.792672 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cdac29bf-a8e2-4807-899c-ad9a32f8f967 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:55.793717 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cdac29bf-a8e2-4807-899c-ad9a32f8f967 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:55.795179 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cdac29bf-a8e2-4807-899c-ad9a32f8f967 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:55.796133 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cdac29bf-a8e2-4807-899c-ad9a32f8f967 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:55.796796 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cdac29bf-a8e2-4807-899c-ad9a32f8f967 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:55.797459 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cdac29bf-a8e2-4807-899c-ad9a32f8f967 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:56.142097 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-cdac29bf-a8e2-4807-899c-ad9a32f8f967 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:56.150622 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-cdac29bf-a8e2-4807-899c-ad9a32f8f967 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.369980 Aug 30 01:02:56.151087 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 141/276] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:55 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:56.613008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-9bbacbe5-5c1b-49cf-8164-9d5ea67cfbf5 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:56.613646 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-9bbacbe5-5c1b-49cf-8164-9d5ea67cfbf5 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] [instance: 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:56.619735 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9bbacbe5-5c1b-49cf-8164-9d5ea67cfbf5 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:56.620232 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9bbacbe5-5c1b-49cf-8164-9d5ea67cfbf5 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:56.621162 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9bbacbe5-5c1b-49cf-8164-9d5ea67cfbf5 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:56.622033 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9bbacbe5-5c1b-49cf-8164-9d5ea67cfbf5 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:56.622630 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9bbacbe5-5c1b-49cf-8164-9d5ea67cfbf5 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:56.623089 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9bbacbe5-5c1b-49cf-8164-9d5ea67cfbf5 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:56.785931 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-9bbacbe5-5c1b-49cf-8164-9d5ea67cfbf5 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c60f3426484bc0baa3107ae3568724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8b8077287845c1815a82a8fdbf51b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:56.805660 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-9bbacbe5-5c1b-49cf-8164-9d5ea67cfbf5 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] 10.222.0.78 "GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8" status: 200 len: 1469 microversion: 2.1 time: 0.195934 Aug 30 01:02:56.806897 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 136/277] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:56 2022] GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 => generated 1469 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:57.172349 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-32eb81ab-98ff-4ff8-9e10-758fe9241b5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:57.173547 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-32eb81ab-98ff-4ff8-9e10-758fe9241b5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:57.180041 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-32eb81ab-98ff-4ff8-9e10-758fe9241b5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:57.180764 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-32eb81ab-98ff-4ff8-9e10-758fe9241b5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:57.181474 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-32eb81ab-98ff-4ff8-9e10-758fe9241b5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:57.182454 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-32eb81ab-98ff-4ff8-9e10-758fe9241b5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:57.183146 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-32eb81ab-98ff-4ff8-9e10-758fe9241b5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:57.183778 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-32eb81ab-98ff-4ff8-9e10-758fe9241b5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:57.473422 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-32eb81ab-98ff-4ff8-9e10-758fe9241b5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:57.483479 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-32eb81ab-98ff-4ff8-9e10-758fe9241b5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.315748 Aug 30 01:02:57.486814 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 142/278] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:57 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:57.836869 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-4b724a01-0745-4447-8281-2c46f7b9d554 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:57.844250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-4b724a01-0745-4447-8281-2c46f7b9d554 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] [instance: 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:57.871224 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4b724a01-0745-4447-8281-2c46f7b9d554 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:57.872051 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4b724a01-0745-4447-8281-2c46f7b9d554 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:57.875298 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4b724a01-0745-4447-8281-2c46f7b9d554 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:57.876398 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4b724a01-0745-4447-8281-2c46f7b9d554 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:57.877662 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4b724a01-0745-4447-8281-2c46f7b9d554 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:57.878452 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4b724a01-0745-4447-8281-2c46f7b9d554 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:57.906657 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-86e4c0a8-f7c9-4c95-8ab5-b606b397b8ed req-ecd294b8-82a1-4e32-8a04-bcef3524b116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a7f7efc-a0a0-4ad5-9627-107cac69b0c8", "name": "network-vif-deleted", "tag": "3986239f-dade-4de4-a3ba-9ecd2f4b9183"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:57.932626 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-86e4c0a8-f7c9-4c95-8ab5-b606b397b8ed req-ecd294b8-82a1-4e32-8a04-bcef3524b116 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:57.945951 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-86e4c0a8-f7c9-4c95-8ab5-b606b397b8ed req-ecd294b8-82a1-4e32-8a04-bcef3524b116 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:57.946748 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-86e4c0a8-f7c9-4c95-8ab5-b606b397b8ed req-ecd294b8-82a1-4e32-8a04-bcef3524b116 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:57.973352 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-86e4c0a8-f7c9-4c95-8ab5-b606b397b8ed req-ecd294b8-82a1-4e32-8a04-bcef3524b116 service nova] Creating event network-vif-deleted:3986239f-dade-4de4-a3ba-9ecd2f4b9183 for instance 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 on hv-cinder-81514 Aug 30 01:02:57.998984 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-4b724a01-0745-4447-8281-2c46f7b9d554 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c60f3426484bc0baa3107ae3568724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8b8077287845c1815a82a8fdbf51b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:58.001042 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-86e4c0a8-f7c9-4c95-8ab5-b606b397b8ed req-ecd294b8-82a1-4e32-8a04-bcef3524b116 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099171 Aug 30 01:02:58.011970 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-4b724a01-0745-4447-8281-2c46f7b9d554 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] 10.222.0.78 "GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8" status: 200 len: 1427 microversion: 2.1 time: 0.184940 Aug 30 01:02:58.019112 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 137/279] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:57 2022] GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 => generated 1427 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:58.019870 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 143/280] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:58.508409 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3e1d0835-e59f-4709-882a-b20c8b96ea17 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:58.509248 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-3e1d0835-e59f-4709-882a-b20c8b96ea17 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:58.522691 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3e1d0835-e59f-4709-882a-b20c8b96ea17 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:58.523176 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3e1d0835-e59f-4709-882a-b20c8b96ea17 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:58.523605 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3e1d0835-e59f-4709-882a-b20c8b96ea17 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:58.524330 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3e1d0835-e59f-4709-882a-b20c8b96ea17 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:58.524828 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3e1d0835-e59f-4709-882a-b20c8b96ea17 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:58.525289 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3e1d0835-e59f-4709-882a-b20c8b96ea17 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:58.663403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3e1d0835-e59f-4709-882a-b20c8b96ea17 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:58.673198 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3e1d0835-e59f-4709-882a-b20c8b96ea17 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.169128 Aug 30 01:02:58.673817 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 138/281] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:58 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:59.041043 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4e0ac29c-e628-4859-af06-cfe3a2de8658 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:59.042418 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-4e0ac29c-e628-4859-af06-cfe3a2de8658 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] [instance: 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:59.049668 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4e0ac29c-e628-4859-af06-cfe3a2de8658 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:59.050377 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4e0ac29c-e628-4859-af06-cfe3a2de8658 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:59.050808 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4e0ac29c-e628-4859-af06-cfe3a2de8658 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:59.051498 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4e0ac29c-e628-4859-af06-cfe3a2de8658 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:59.051944 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4e0ac29c-e628-4859-af06-cfe3a2de8658 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:59.052392 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4e0ac29c-e628-4859-af06-cfe3a2de8658 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:59.065822 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-4e0ac29c-e628-4859-af06-cfe3a2de8658 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] HTTP exception thrown: Instance 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 could not be found. Aug 30 01:02:59.067456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4e0ac29c-e628-4859-af06-cfe3a2de8658 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Request method failure captured: Aug 30 01:02:59.067456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 HTTP/1.1 Aug 30 01:02:59.067456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:02:59.067456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:02:59.067456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:02:59.067456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:02:59.067456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:02:59.067456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:02:59.067456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:02:59.067456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:02:59.067456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWGrr6Z0PD8nBpwHZ0prH_QN57w8emYSCzqUkPUzwLZCfHzggt5wbDTA-bdWCBS037MTck7S0WAUXlTeWij6xaqMJrMAgJyHL6qgSbk3COPCQIsmw5enLmrQgiXi_KpbIzIc-Y5OXc9S4jXOB6VsBRZUxwtt7itCPm8mKu8bWpCJgac Aug 30 01:02:59.067456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:02:59.067456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:02:59.067456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:02:59.067456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:02:59.067456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:02:59.067456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:02:59.067456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: 8a8b8077287845c1815a82a8fdbf51b6 Aug 30 01:02:59.067456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-VolumesNegativeTest-97908648 Aug 30 01:02:59.067456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:02:59.067456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:02:59.069188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8a8b8077287845c1815a82a8fdbf51b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8a8b8077287845c1815a82a8fdbf51b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8a8b8077287845c1815a82a8fdbf51b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8a8b8077287845c1815a82a8fdbf51b6"}]}] Aug 30 01:02:59.069188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-VolumesNegativeTest-97908648 Aug 30 01:02:59.069188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: 8a8b8077287845c1815a82a8fdbf51b6 Aug 30 01:02:59.069188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-VolumesNegativeTest-97908648 Aug 30 01:02:59.069188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-VolumesNegativeTest-97908648-project Aug 30 01:02:59.069188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:02:59.069188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:02:59.069188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: a2c60f3426484bc0baa3107ae3568724 Aug 30 01:02:59.069188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-VolumesNegativeTest-97908648-project Aug 30 01:02:59.069188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:02:59.069188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Instance 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 could not be found. Aug 30 01:02:59.069188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': '6a7f7efc-a0a0-4ad5-9627-107cac69b0c8'} Aug 30 01:02:59.070134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:02:59.070134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:59.070134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:02:59.070134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:02:59.070134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:02:59.070134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:02:59.070134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:02:59.070134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:02:59.070134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:02:59.070134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:02:59.070134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 could not be found. Aug 30 01:02:59.070134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:59.070134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:59.070134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:59.070134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:59.070134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:59.070134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:59.070134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:02:59.070134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:02:59.070134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:02:59.071619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:02:59.071619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:02:59.071619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:02:59.071619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:02:59.071619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:02:59.071619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:02:59.071619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:02:59.071619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 could not be found. Aug 30 01:02:59.071619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:59.071619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:59.071619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:59.071619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:59.071619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:59.071619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:59.071619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:02:59.071619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:02:59.071619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 could not be found. Aug 30 01:02:59.071619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:02:59.074245 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4e0ac29c-e628-4859-af06-cfe3a2de8658 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] Returning 404 to user: Instance 6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:02:59.074245 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-4e0ac29c-e628-4859-af06-cfe3a2de8658 tempest-VolumesNegativeTest-97908648 tempest-VolumesNegativeTest-97908648-project] 10.222.0.78 "GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8" status: 404 len: 111 microversion: 2.1 time: 0.032778 Aug 30 01:02:59.074245 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 144/282] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:59 2022] GET /compute/v2.1/servers/6a7f7efc-a0a0-4ad5-9627-107cac69b0c8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:02:59.700901 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0b406abf-e001-4c62-9006-36a93b4a379e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:59.701693 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-0b406abf-e001-4c62-9006-36a93b4a379e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:59.707862 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b406abf-e001-4c62-9006-36a93b4a379e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:59.708432 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b406abf-e001-4c62-9006-36a93b4a379e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:59.708945 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b406abf-e001-4c62-9006-36a93b4a379e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:59.709779 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b406abf-e001-4c62-9006-36a93b4a379e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:59.710235 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b406abf-e001-4c62-9006-36a93b4a379e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:59.710662 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b406abf-e001-4c62-9006-36a93b4a379e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:59.828548 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-49946017-6cc8-46a3-9159-d816a75d41b9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:59.829679 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-49946017-6cc8-46a3-9159-d816a75d41b9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:59.837038 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-49946017-6cc8-46a3-9159-d816a75d41b9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:59.837791 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-49946017-6cc8-46a3-9159-d816a75d41b9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:59.838227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-49946017-6cc8-46a3-9159-d816a75d41b9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:59.839107 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-49946017-6cc8-46a3-9159-d816a75d41b9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:59.839719 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-49946017-6cc8-46a3-9159-d816a75d41b9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:59.840309 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-49946017-6cc8-46a3-9159-d816a75d41b9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:59.862266 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-0b406abf-e001-4c62-9006-36a93b4a379e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:59.870116 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0b406abf-e001-4c62-9006-36a93b4a379e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.175674 Aug 30 01:02:59.871615 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 139/283] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:59 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:59.890202 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-49946017-6cc8-46a3-9159-d816a75d41b9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2/ips" status: 200 len: 143 microversion: 2.1 time: 0.065987 Aug 30 01:02:59.890798 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 145/284] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 30 01:02:59 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2/ips => generated 143 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:03:00.894250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-ab52c0c0-db06-4f3c-a782-62d9f416a1cd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:00.896641 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-ab52c0c0-db06-4f3c-a782-62d9f416a1cd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:00.906015 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ab52c0c0-db06-4f3c-a782-62d9f416a1cd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:00.906948 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ab52c0c0-db06-4f3c-a782-62d9f416a1cd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:00.907394 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ab52c0c0-db06-4f3c-a782-62d9f416a1cd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:00.908281 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ab52c0c0-db06-4f3c-a782-62d9f416a1cd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:00.909216 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ab52c0c0-db06-4f3c-a782-62d9f416a1cd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:00.910407 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ab52c0c0-db06-4f3c-a782-62d9f416a1cd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:01.081859 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-ab52c0c0-db06-4f3c-a782-62d9f416a1cd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:01.090046 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-ab52c0c0-db06-4f3c-a782-62d9f416a1cd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.202458 Aug 30 01:03:01.091626 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 140/285] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:00 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:02.114267 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-0e469684-9de5-400a-9842-b3a12d873fa7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:02.115848 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-0e469684-9de5-400a-9842-b3a12d873fa7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:02.137804 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0e469684-9de5-400a-9842-b3a12d873fa7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:02.138368 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0e469684-9de5-400a-9842-b3a12d873fa7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:02.138818 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0e469684-9de5-400a-9842-b3a12d873fa7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:02.139563 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0e469684-9de5-400a-9842-b3a12d873fa7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:02.140026 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0e469684-9de5-400a-9842-b3a12d873fa7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:02.140456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0e469684-9de5-400a-9842-b3a12d873fa7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:02.367271 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-0e469684-9de5-400a-9842-b3a12d873fa7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:02.385954 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-0e469684-9de5-400a-9842-b3a12d873fa7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.275887 Aug 30 01:03:02.387598 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 146/286] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:02 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:03.411192 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3f137f7d-b062-4db0-879d-522749060498 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:03.411983 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-3f137f7d-b062-4db0-879d-522749060498 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:03.418796 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3f137f7d-b062-4db0-879d-522749060498 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:03.420063 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3f137f7d-b062-4db0-879d-522749060498 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:03.420695 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3f137f7d-b062-4db0-879d-522749060498 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:03.421462 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3f137f7d-b062-4db0-879d-522749060498 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:03.421998 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3f137f7d-b062-4db0-879d-522749060498 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:03.422425 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3f137f7d-b062-4db0-879d-522749060498 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:03.575942 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3f137f7d-b062-4db0-879d-522749060498 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:03.586177 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3f137f7d-b062-4db0-879d-522749060498 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.179029 Aug 30 01:03:03.587072 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 141/287] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:03 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:04.633007 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8a0fabc6-9e68-4485-8566-daac850a235f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:04.633693 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8a0fabc6-9e68-4485-8566-daac850a235f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:04.648248 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a0fabc6-9e68-4485-8566-daac850a235f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:04.648755 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a0fabc6-9e68-4485-8566-daac850a235f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:04.649226 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a0fabc6-9e68-4485-8566-daac850a235f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:04.649936 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a0fabc6-9e68-4485-8566-daac850a235f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:04.650575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a0fabc6-9e68-4485-8566-daac850a235f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:04.651009 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a0fabc6-9e68-4485-8566-daac850a235f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:04.840344 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8a0fabc6-9e68-4485-8566-daac850a235f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:04.848900 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8a0fabc6-9e68-4485-8566-daac850a235f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.219696 Aug 30 01:03:04.849710 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 147/288] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:04 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:05.285546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-00d0c85b-658b-48a3-b384-3c16ea75fbdd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c19e17b-193c-4d03-be52-4913b5358bde"}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:05.288121 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-00d0c85b-658b-48a3-b384-3c16ea75fbdd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:05.291515 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:05.298100 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-00d0c85b-658b-48a3-b384-3c16ea75fbdd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:05.298654 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-00d0c85b-658b-48a3-b384-3c16ea75fbdd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:05.299502 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-00d0c85b-658b-48a3-b384-3c16ea75fbdd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:05.300272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-00d0c85b-658b-48a3-b384-3c16ea75fbdd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:05.300862 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-00d0c85b-658b-48a3-b384-3c16ea75fbdd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:05.301406 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-00d0c85b-658b-48a3-b384-3c16ea75fbdd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:05.608313 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-00d0c85b-658b-48a3-b384-3c16ea75fbdd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "POST /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327150 Aug 30 01:03:05.609351 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 142/289] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 30 01:03:05 2022] POST /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2/os-volume_attachments => generated 194 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:05.871227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4d2e3357-4b84-4e63-9a3f-cf8c03a0a6a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:05.871845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-4d2e3357-4b84-4e63-9a3f-cf8c03a0a6a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:05.878771 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4d2e3357-4b84-4e63-9a3f-cf8c03a0a6a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:05.879479 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4d2e3357-4b84-4e63-9a3f-cf8c03a0a6a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:05.879915 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4d2e3357-4b84-4e63-9a3f-cf8c03a0a6a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:05.880796 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4d2e3357-4b84-4e63-9a3f-cf8c03a0a6a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:05.881531 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4d2e3357-4b84-4e63-9a3f-cf8c03a0a6a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:05.882234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4d2e3357-4b84-4e63-9a3f-cf8c03a0a6a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:06.026894 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-4d2e3357-4b84-4e63-9a3f-cf8c03a0a6a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:06.041051 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-4d2e3357-4b84-4e63-9a3f-cf8c03a0a6a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.174033 Aug 30 01:03:06.042372 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 148/290] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:05 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:07.064013 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-00ca1885-4929-481e-9490-1f6c675fd87c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:07.064861 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-00ca1885-4929-481e-9490-1f6c675fd87c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:07.077451 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-00ca1885-4929-481e-9490-1f6c675fd87c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:07.077969 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-00ca1885-4929-481e-9490-1f6c675fd87c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:07.078407 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-00ca1885-4929-481e-9490-1f6c675fd87c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:07.079119 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-00ca1885-4929-481e-9490-1f6c675fd87c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:07.079571 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-00ca1885-4929-481e-9490-1f6c675fd87c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:07.080366 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-00ca1885-4929-481e-9490-1f6c675fd87c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:07.456534 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-00ca1885-4929-481e-9490-1f6c675fd87c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:07.464968 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-00ca1885-4929-481e-9490-1f6c675fd87c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.405906 Aug 30 01:03:07.467997 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 143/291] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:07 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:08.271925 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-2437de23-be4d-4363-9cfd-2a3d3b48fa0a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:08.272712 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-2437de23-be4d-4363-9cfd-2a3d3b48fa0a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:08.283616 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2437de23-be4d-4363-9cfd-2a3d3b48fa0a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:08.285064 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2437de23-be4d-4363-9cfd-2a3d3b48fa0a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:08.285724 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2437de23-be4d-4363-9cfd-2a3d3b48fa0a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:08.286942 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2437de23-be4d-4363-9cfd-2a3d3b48fa0a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:08.287548 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2437de23-be4d-4363-9cfd-2a3d3b48fa0a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:08.288397 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2437de23-be4d-4363-9cfd-2a3d3b48fa0a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:08.313306 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:08.322563 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-2437de23-be4d-4363-9cfd-2a3d3b48fa0a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae/ips" status: 200 len: 148 microversion: 2.1 time: 0.057054 Aug 30 01:03:08.323306 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 149/292] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 30 01:03:08 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae/ips => generated 148 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:08.490337 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-6a458d37-98e6-4b73-88c6-e8522c82852c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:08.491865 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-6a458d37-98e6-4b73-88c6-e8522c82852c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:08.515678 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6a458d37-98e6-4b73-88c6-e8522c82852c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:08.516569 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6a458d37-98e6-4b73-88c6-e8522c82852c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:08.517201 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6a458d37-98e6-4b73-88c6-e8522c82852c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:08.519288 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6a458d37-98e6-4b73-88c6-e8522c82852c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:08.523400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6a458d37-98e6-4b73-88c6-e8522c82852c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:08.524059 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6a458d37-98e6-4b73-88c6-e8522c82852c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:08.784508 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6a458d37-98e6-4b73-88c6-e8522c82852c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:08.795283 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-6a458d37-98e6-4b73-88c6-e8522c82852c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1521 microversion: 2.1 time: 0.309459 Aug 30 01:03:08.796743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 144/293] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:08 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:09.823577 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-e92ad141-2712-4a02-a1ee-7bd1a6a6fe3c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:09.824189 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-e92ad141-2712-4a02-a1ee-7bd1a6a6fe3c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:09.831937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e92ad141-2712-4a02-a1ee-7bd1a6a6fe3c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:09.832787 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e92ad141-2712-4a02-a1ee-7bd1a6a6fe3c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:09.833479 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e92ad141-2712-4a02-a1ee-7bd1a6a6fe3c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:09.834481 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e92ad141-2712-4a02-a1ee-7bd1a6a6fe3c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:09.835200 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e92ad141-2712-4a02-a1ee-7bd1a6a6fe3c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:09.835820 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e92ad141-2712-4a02-a1ee-7bd1a6a6fe3c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:10.023648 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-c417560c-3078-410c-bb50-71733913111d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f7cf8ad-eb76-4276-bbe3-3008de1d4538"}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:10.026387 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-c417560c-3078-410c-bb50-71733913111d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:10.042221 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c417560c-3078-410c-bb50-71733913111d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:10.042750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c417560c-3078-410c-bb50-71733913111d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:10.046837 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c417560c-3078-410c-bb50-71733913111d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:10.049064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c417560c-3078-410c-bb50-71733913111d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:10.051422 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c417560c-3078-410c-bb50-71733913111d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:10.052039 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c417560c-3078-410c-bb50-71733913111d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:10.140829 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-e92ad141-2712-4a02-a1ee-7bd1a6a6fe3c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:10.149404 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-e92ad141-2712-4a02-a1ee-7bd1a6a6fe3c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1501 microversion: 2.1 time: 0.333825 Aug 30 01:03:10.165049 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 150/294] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:09 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1501 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:10.177651 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8146c529-2650-4e3f-98a1-eede234d7177 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:10.178270 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8146c529-2650-4e3f-98a1-eede234d7177 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:10.203289 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8146c529-2650-4e3f-98a1-eede234d7177 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:10.205268 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8146c529-2650-4e3f-98a1-eede234d7177 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:10.205877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8146c529-2650-4e3f-98a1-eede234d7177 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:10.208681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8146c529-2650-4e3f-98a1-eede234d7177 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:10.211161 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8146c529-2650-4e3f-98a1-eede234d7177 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:10.213928 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8146c529-2650-4e3f-98a1-eede234d7177 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:10.223953 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:10.430129 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8146c529-2650-4e3f-98a1-eede234d7177 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:10.440729 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8146c529-2650-4e3f-98a1-eede234d7177 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1516 microversion: 2.1 time: 0.266848 Aug 30 01:03:10.441822 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 151/295] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:10 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1516 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:10.497974 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-c417560c-3078-410c-bb50-71733913111d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "POST /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.476789 Aug 30 01:03:10.498672 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 145/296] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 30 01:03:10 2022] POST /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae/os-volume_attachments => generated 194 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:03:15.131598 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-5a59e1f8-ddfe-4131-be89-a679777ec53b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:15.134360 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-5a59e1f8-ddfe-4131-be89-a679777ec53b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:15.137921 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:15.162607 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5a59e1f8-ddfe-4131-be89-a679777ec53b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:15.163600 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5a59e1f8-ddfe-4131-be89-a679777ec53b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:15.164935 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5a59e1f8-ddfe-4131-be89-a679777ec53b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:15.166355 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5a59e1f8-ddfe-4131-be89-a679777ec53b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:15.167116 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5a59e1f8-ddfe-4131-be89-a679777ec53b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:15.168424 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5a59e1f8-ddfe-4131-be89-a679777ec53b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:15.215393 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.objects.instance [None req-5a59e1f8-ddfe-4131-be89-a679777ec53b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lazy-loading 'flavor' on Instance uuid 12338ddc-349d-4f0b-b6d8-4bb83f19e320 {{(pid=120630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:03:15.389130 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-5a59e1f8-ddfe-4131-be89-a679777ec53b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "POST /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320/action" status: 200 len: 32 microversion: 2.1 time: 0.263934 Aug 30 01:03:15.395783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 152/297] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 30 01:03:15 2022] POST /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320/action => generated 32 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:03:15.411996 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-c3058513-5bb2-4684-b530-eabbe3362f2a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:15.415350 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-c3058513-5bb2-4684-b530-eabbe3362f2a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:15.436475 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c3058513-5bb2-4684-b530-eabbe3362f2a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:15.437140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c3058513-5bb2-4684-b530-eabbe3362f2a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:15.437872 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c3058513-5bb2-4684-b530-eabbe3362f2a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:15.439565 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c3058513-5bb2-4684-b530-eabbe3362f2a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:15.440742 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c3058513-5bb2-4684-b530-eabbe3362f2a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:15.443918 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c3058513-5bb2-4684-b530-eabbe3362f2a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:15.782289 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-15082773-d114-4a86-a608-8150fae4df1e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:15.791904 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-15082773-d114-4a86-a608-8150fae4df1e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:15.792522 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-15082773-d114-4a86-a608-8150fae4df1e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:15.798512 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-15082773-d114-4a86-a608-8150fae4df1e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:15.954082 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-15082773-d114-4a86-a608-8150fae4df1e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Going to try to stop instance {{(pid=120630) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 01:03:15.992658 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-c3058513-5bb2-4684-b530-eabbe3362f2a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:16.008787 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-c3058513-5bb2-4684-b530-eabbe3362f2a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.605392 Aug 30 01:03:16.009664 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 146/298] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:15 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:16.092974 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-15082773-d114-4a86-a608-8150fae4df1e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "POST /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2/action" status: 202 len: 0 microversion: 2.1 time: 0.316559 Aug 30 01:03:16.094242 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 153/299] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 30 01:03:15 2022] POST /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:03:16.102090 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-13e36db0-994f-48dd-99f7-07d9cd9f3496 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:16.102946 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-13e36db0-994f-48dd-99f7-07d9cd9f3496 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:16.115899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-13e36db0-994f-48dd-99f7-07d9cd9f3496 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:16.125824 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-13e36db0-994f-48dd-99f7-07d9cd9f3496 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:16.126510 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-13e36db0-994f-48dd-99f7-07d9cd9f3496 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:16.127736 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-13e36db0-994f-48dd-99f7-07d9cd9f3496 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:16.131838 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-13e36db0-994f-48dd-99f7-07d9cd9f3496 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:16.132456 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-13e36db0-994f-48dd-99f7-07d9cd9f3496 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:17.035320 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-c32c853c-8aec-450d-95ba-4679ad9d8b28 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:17.036031 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-c32c853c-8aec-450d-95ba-4679ad9d8b28 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:17.052888 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c32c853c-8aec-450d-95ba-4679ad9d8b28 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:17.053423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c32c853c-8aec-450d-95ba-4679ad9d8b28 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:17.054043 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c32c853c-8aec-450d-95ba-4679ad9d8b28 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:17.054775 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c32c853c-8aec-450d-95ba-4679ad9d8b28 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:17.055379 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c32c853c-8aec-450d-95ba-4679ad9d8b28 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:17.055760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c32c853c-8aec-450d-95ba-4679ad9d8b28 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:17.391833 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-13e36db0-994f-48dd-99f7-07d9cd9f3496 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:17.422921 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-13e36db0-994f-48dd-99f7-07d9cd9f3496 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 1.322580 Aug 30 01:03:17.453602 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 147/300] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:16 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:17.984909 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-c32c853c-8aec-450d-95ba-4679ad9d8b28 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:17.994244 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-c32c853c-8aec-450d-95ba-4679ad9d8b28 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.963542 Aug 30 01:03:18.008924 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 154/301] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:17 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:18.451563 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-58fa8a36-c07a-4d8b-ab50-8a348fb463cf tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:18.452260 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-58fa8a36-c07a-4d8b-ab50-8a348fb463cf tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:18.475791 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-58fa8a36-c07a-4d8b-ab50-8a348fb463cf tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:18.476931 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-58fa8a36-c07a-4d8b-ab50-8a348fb463cf tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:18.477910 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-58fa8a36-c07a-4d8b-ab50-8a348fb463cf tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:18.479916 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-58fa8a36-c07a-4d8b-ab50-8a348fb463cf tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:18.480537 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-58fa8a36-c07a-4d8b-ab50-8a348fb463cf tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:18.481743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-58fa8a36-c07a-4d8b-ab50-8a348fb463cf tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:19.020602 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-b314d36b-f496-411f-b3c1-4b613d34a9b6 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:19.022065 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-b314d36b-f496-411f-b3c1-4b613d34a9b6 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:19.034644 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b314d36b-f496-411f-b3c1-4b613d34a9b6 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:19.049343 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b314d36b-f496-411f-b3c1-4b613d34a9b6 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:19.050633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b314d36b-f496-411f-b3c1-4b613d34a9b6 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:19.053312 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b314d36b-f496-411f-b3c1-4b613d34a9b6 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:19.054001 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b314d36b-f496-411f-b3c1-4b613d34a9b6 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:19.054616 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b314d36b-f496-411f-b3c1-4b613d34a9b6 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:19.118990 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-58fa8a36-c07a-4d8b-ab50-8a348fb463cf tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:19.128840 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-58fa8a36-c07a-4d8b-ab50-8a348fb463cf tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.683273 Aug 30 01:03:19.141973 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 148/302] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:18 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:19.530525 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-b314d36b-f496-411f-b3c1-4b613d34a9b6 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:19.544234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-b314d36b-f496-411f-b3c1-4b613d34a9b6 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.527719 Aug 30 01:03:19.545669 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 155/303] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:19 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:20.160438 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-11de5efe-559d-4b79-8ab1-45c03371a8d5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:20.161581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-11de5efe-559d-4b79-8ab1-45c03371a8d5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:20.179523 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-11de5efe-559d-4b79-8ab1-45c03371a8d5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:20.183893 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-11de5efe-559d-4b79-8ab1-45c03371a8d5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:20.184682 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-11de5efe-559d-4b79-8ab1-45c03371a8d5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:20.185458 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-11de5efe-559d-4b79-8ab1-45c03371a8d5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:20.185923 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-11de5efe-559d-4b79-8ab1-45c03371a8d5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:20.186362 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-11de5efe-559d-4b79-8ab1-45c03371a8d5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:20.385934 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-11de5efe-559d-4b79-8ab1-45c03371a8d5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:20.395437 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-11de5efe-559d-4b79-8ab1-45c03371a8d5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.247025 Aug 30 01:03:20.396492 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 149/304] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:20 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:20.569657 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-0a565aeb-71dc-4b41-b42c-053bad280556 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:20.570881 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-0a565aeb-71dc-4b41-b42c-053bad280556 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:20.578564 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0a565aeb-71dc-4b41-b42c-053bad280556 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:20.579106 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0a565aeb-71dc-4b41-b42c-053bad280556 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:20.579512 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0a565aeb-71dc-4b41-b42c-053bad280556 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:20.580268 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0a565aeb-71dc-4b41-b42c-053bad280556 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:20.580646 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0a565aeb-71dc-4b41-b42c-053bad280556 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:20.586348 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0a565aeb-71dc-4b41-b42c-053bad280556 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:20.882415 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-0a565aeb-71dc-4b41-b42c-053bad280556 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:20.897962 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-0a565aeb-71dc-4b41-b42c-053bad280556 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.332009 Aug 30 01:03:20.900331 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 156/305] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:20 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:21.420234 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-ca7cf0e9-9839-4539-8c8c-0162cc0f2140 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:21.420857 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-ca7cf0e9-9839-4539-8c8c-0162cc0f2140 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:21.428920 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ca7cf0e9-9839-4539-8c8c-0162cc0f2140 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:21.429745 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ca7cf0e9-9839-4539-8c8c-0162cc0f2140 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:21.430446 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ca7cf0e9-9839-4539-8c8c-0162cc0f2140 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:21.431396 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ca7cf0e9-9839-4539-8c8c-0162cc0f2140 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:21.431918 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ca7cf0e9-9839-4539-8c8c-0162cc0f2140 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:21.432361 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ca7cf0e9-9839-4539-8c8c-0162cc0f2140 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:21.926348 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f0615966-de6c-43fe-9822-1bb7e452ea2f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:21.926348 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-f0615966-de6c-43fe-9822-1bb7e452ea2f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:21.937698 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f0615966-de6c-43fe-9822-1bb7e452ea2f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:21.939247 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f0615966-de6c-43fe-9822-1bb7e452ea2f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:21.941724 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f0615966-de6c-43fe-9822-1bb7e452ea2f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:21.944271 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f0615966-de6c-43fe-9822-1bb7e452ea2f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:21.944924 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f0615966-de6c-43fe-9822-1bb7e452ea2f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:21.945573 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f0615966-de6c-43fe-9822-1bb7e452ea2f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:22.252083 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-ca7cf0e9-9839-4539-8c8c-0162cc0f2140 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:22.264040 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-ca7cf0e9-9839-4539-8c8c-0162cc0f2140 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.849972 Aug 30 01:03:22.264674 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 150/306] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:21 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:22.388838 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-f0615966-de6c-43fe-9822-1bb7e452ea2f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:22.398242 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-f0615966-de6c-43fe-9822-1bb7e452ea2f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.477290 Aug 30 01:03:22.399419 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 157/307] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:21 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:23.288877 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-4c0b7ec5-f459-48df-986e-67aa8d99b9e9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:23.289870 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-4c0b7ec5-f459-48df-986e-67aa8d99b9e9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:23.297117 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4c0b7ec5-f459-48df-986e-67aa8d99b9e9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:23.297640 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4c0b7ec5-f459-48df-986e-67aa8d99b9e9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:23.298082 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4c0b7ec5-f459-48df-986e-67aa8d99b9e9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:23.298797 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4c0b7ec5-f459-48df-986e-67aa8d99b9e9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:23.299259 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4c0b7ec5-f459-48df-986e-67aa8d99b9e9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:23.299885 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4c0b7ec5-f459-48df-986e-67aa8d99b9e9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:23.428493 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-87137614-da1a-4513-8e14-9b8614c6699d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:23.428493 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-87137614-da1a-4513-8e14-9b8614c6699d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:23.430393 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-87137614-da1a-4513-8e14-9b8614c6699d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:23.430896 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-87137614-da1a-4513-8e14-9b8614c6699d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:23.431333 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-87137614-da1a-4513-8e14-9b8614c6699d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:23.432229 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-87137614-da1a-4513-8e14-9b8614c6699d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:23.432699 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-87137614-da1a-4513-8e14-9b8614c6699d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:23.433150 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-87137614-da1a-4513-8e14-9b8614c6699d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:23.556781 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-4c0b7ec5-f459-48df-986e-67aa8d99b9e9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:23.568774 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-4c0b7ec5-f459-48df-986e-67aa8d99b9e9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.284397 Aug 30 01:03:23.570089 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 151/308] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:23 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:23.687503 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-87137614-da1a-4513-8e14-9b8614c6699d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:23.695549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-87137614-da1a-4513-8e14-9b8614c6699d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.279771 Aug 30 01:03:23.696202 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 158/309] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:23 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:24.592399 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-74d076fb-bebf-4c67-b1c9-2b352572fb32 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:24.593863 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-74d076fb-bebf-4c67-b1c9-2b352572fb32 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:24.600598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-74d076fb-bebf-4c67-b1c9-2b352572fb32 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:24.601444 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-74d076fb-bebf-4c67-b1c9-2b352572fb32 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:24.602102 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-74d076fb-bebf-4c67-b1c9-2b352572fb32 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:24.603031 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-74d076fb-bebf-4c67-b1c9-2b352572fb32 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:24.603849 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-74d076fb-bebf-4c67-b1c9-2b352572fb32 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:24.604504 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-74d076fb-bebf-4c67-b1c9-2b352572fb32 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:24.718407 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-5d924a8d-25b8-4c39-b2ac-53fba40ce24b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:24.720329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-5d924a8d-25b8-4c39-b2ac-53fba40ce24b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:24.727019 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5d924a8d-25b8-4c39-b2ac-53fba40ce24b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:24.727821 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5d924a8d-25b8-4c39-b2ac-53fba40ce24b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:24.728473 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5d924a8d-25b8-4c39-b2ac-53fba40ce24b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:24.729420 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5d924a8d-25b8-4c39-b2ac-53fba40ce24b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:24.730105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5d924a8d-25b8-4c39-b2ac-53fba40ce24b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:24.731390 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5d924a8d-25b8-4c39-b2ac-53fba40ce24b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:24.877694 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-74d076fb-bebf-4c67-b1c9-2b352572fb32 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:24.886366 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-74d076fb-bebf-4c67-b1c9-2b352572fb32 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.298456 Aug 30 01:03:24.897354 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 152/310] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:24 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:25.016431 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-5d924a8d-25b8-4c39-b2ac-53fba40ce24b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:25.025477 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-5d924a8d-25b8-4c39-b2ac-53fba40ce24b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.311473 Aug 30 01:03:25.030115 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 159/311] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:24 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:25.912482 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-4466e103-8bf8-4b9f-9ee3-6e270babecdd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:25.913399 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-4466e103-8bf8-4b9f-9ee3-6e270babecdd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:25.926191 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4466e103-8bf8-4b9f-9ee3-6e270babecdd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:25.926789 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4466e103-8bf8-4b9f-9ee3-6e270babecdd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:25.927334 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4466e103-8bf8-4b9f-9ee3-6e270babecdd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:25.930144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4466e103-8bf8-4b9f-9ee3-6e270babecdd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:25.930718 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4466e103-8bf8-4b9f-9ee3-6e270babecdd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:25.931253 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4466e103-8bf8-4b9f-9ee3-6e270babecdd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:26.051363 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-e2636b27-ffe5-4c7a-8298-99f476b07fdd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:26.052748 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-e2636b27-ffe5-4c7a-8298-99f476b07fdd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:26.064327 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e2636b27-ffe5-4c7a-8298-99f476b07fdd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:26.064959 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e2636b27-ffe5-4c7a-8298-99f476b07fdd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:26.073120 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e2636b27-ffe5-4c7a-8298-99f476b07fdd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:26.074065 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e2636b27-ffe5-4c7a-8298-99f476b07fdd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:26.074745 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e2636b27-ffe5-4c7a-8298-99f476b07fdd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:26.075191 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e2636b27-ffe5-4c7a-8298-99f476b07fdd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:26.268926 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-4466e103-8bf8-4b9f-9ee3-6e270babecdd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:26.283655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-4466e103-8bf8-4b9f-9ee3-6e270babecdd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.376588 Aug 30 01:03:26.286156 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 153/312] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:25 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:26.352544 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-e2636b27-ffe5-4c7a-8298-99f476b07fdd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:26.376047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-e2636b27-ffe5-4c7a-8298-99f476b07fdd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.328628 Aug 30 01:03:26.376626 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 160/313] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:26 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:27.308659 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-22b398e5-cd82-444f-a39d-d448234dfde3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:27.310066 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-22b398e5-cd82-444f-a39d-d448234dfde3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:27.326239 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-22b398e5-cd82-444f-a39d-d448234dfde3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:27.327492 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-22b398e5-cd82-444f-a39d-d448234dfde3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:27.328539 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-22b398e5-cd82-444f-a39d-d448234dfde3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:27.330130 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-22b398e5-cd82-444f-a39d-d448234dfde3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:27.331387 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-22b398e5-cd82-444f-a39d-d448234dfde3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:27.332323 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-22b398e5-cd82-444f-a39d-d448234dfde3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:27.401147 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4b43e40c-ae98-443f-b8ee-dd855559dff7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:27.403744 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-4b43e40c-ae98-443f-b8ee-dd855559dff7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:27.424824 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4b43e40c-ae98-443f-b8ee-dd855559dff7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:27.426089 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4b43e40c-ae98-443f-b8ee-dd855559dff7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:27.426733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4b43e40c-ae98-443f-b8ee-dd855559dff7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:27.427818 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4b43e40c-ae98-443f-b8ee-dd855559dff7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:27.430947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4b43e40c-ae98-443f-b8ee-dd855559dff7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:27.436463 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4b43e40c-ae98-443f-b8ee-dd855559dff7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:27.953167 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-22b398e5-cd82-444f-a39d-d448234dfde3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:27.964234 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-22b398e5-cd82-444f-a39d-d448234dfde3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.660311 Aug 30 01:03:27.984111 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-4b43e40c-ae98-443f-b8ee-dd855559dff7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:27.990298 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 154/314] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:27 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:28.009827 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-4b43e40c-ae98-443f-b8ee-dd855559dff7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.615854 Aug 30 01:03:28.010671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 161/315] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:27 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:28.987261 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-02b6d953-3ebd-48fe-af00-c8763fc4718b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:28.987876 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-02b6d953-3ebd-48fe-af00-c8763fc4718b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:29.002723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-02b6d953-3ebd-48fe-af00-c8763fc4718b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:29.003384 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-02b6d953-3ebd-48fe-af00-c8763fc4718b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:29.003784 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-02b6d953-3ebd-48fe-af00-c8763fc4718b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:29.004596 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-02b6d953-3ebd-48fe-af00-c8763fc4718b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:29.005218 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-02b6d953-3ebd-48fe-af00-c8763fc4718b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:29.005785 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-02b6d953-3ebd-48fe-af00-c8763fc4718b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:29.034443 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-adf51cb5-f96b-453c-842c-952bf1b7b831 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:29.035806 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-adf51cb5-f96b-453c-842c-952bf1b7b831 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:29.048414 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-adf51cb5-f96b-453c-842c-952bf1b7b831 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:29.051796 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-adf51cb5-f96b-453c-842c-952bf1b7b831 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:29.052506 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-adf51cb5-f96b-453c-842c-952bf1b7b831 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:29.054780 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-adf51cb5-f96b-453c-842c-952bf1b7b831 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:29.055507 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-adf51cb5-f96b-453c-842c-952bf1b7b831 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:29.057705 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-adf51cb5-f96b-453c-842c-952bf1b7b831 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:29.364163 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-adf51cb5-f96b-453c-842c-952bf1b7b831 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:29.376611 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-02b6d953-3ebd-48fe-af00-c8763fc4718b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:29.384077 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-adf51cb5-f96b-453c-842c-952bf1b7b831 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.355941 Aug 30 01:03:29.385282 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 162/316] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:29 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:29.397957 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-02b6d953-3ebd-48fe-af00-c8763fc4718b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.414501 Aug 30 01:03:29.416568 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 155/317] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:28 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:29.466675 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-347ad969-b620-4589-bc43-7f4d98015a3f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Action: 'create', calling method: .version_select at 0x7f0f52a0da60>, body: {"keypair": {"name": "tempest-keypair-1827563118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2Df4506if54a49na8ScQvalRYX2u4pKqiEbt4K3GGI0uQ4T9UQDnChSaj9LZfqrLcdvP55I8eduqvMvCNSwJuFGSsm8oUpJk4z1gp7EgPVpalhN4j4gN8iZq6IbENXMQ=="}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:29.499346 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-347ad969-b620-4589-bc43-7f4d98015a3f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Getting quotas for project 0596692dbfb149139a1e72159c6f93db. Resources: {'key_pairs'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:03:29.503610 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-347ad969-b620-4589-bc43-7f4d98015a3f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Getting quotas for user cc7cf306aadb45d1b65252b53c86b612 and project 0596692dbfb149139a1e72159c6f93db. Resources: {'key_pairs'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:03:29.571191 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-347ad969-b620-4589-bc43-7f4d98015a3f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.109203 Aug 30 01:03:29.571797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 163/318] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 30 01:03:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:03:30.417594 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-90cb02db-4ca9-4dd4-b26f-978ca16db7de tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:30.424286 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-d648c3a6-2088-476e-a691-fe7849ca4a53 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:30.425470 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-d648c3a6-2088-476e-a691-fe7849ca4a53 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:30.437811 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-90cb02db-4ca9-4dd4-b26f-978ca16db7de tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:30.445360 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-90cb02db-4ca9-4dd4-b26f-978ca16db7de tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:30.446340 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-90cb02db-4ca9-4dd4-b26f-978ca16db7de tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:30.446985 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-90cb02db-4ca9-4dd4-b26f-978ca16db7de tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:30.448308 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-90cb02db-4ca9-4dd4-b26f-978ca16db7de tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:30.449826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-90cb02db-4ca9-4dd4-b26f-978ca16db7de tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:30.450662 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-90cb02db-4ca9-4dd4-b26f-978ca16db7de tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:30.453812 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d648c3a6-2088-476e-a691-fe7849ca4a53 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:30.454278 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d648c3a6-2088-476e-a691-fe7849ca4a53 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:30.454731 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d648c3a6-2088-476e-a691-fe7849ca4a53 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:30.455441 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d648c3a6-2088-476e-a691-fe7849ca4a53 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:30.455901 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d648c3a6-2088-476e-a691-fe7849ca4a53 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:30.456330 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d648c3a6-2088-476e-a691-fe7849ca4a53 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:30.569540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:31.042950 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-90cb02db-4ca9-4dd4-b26f-978ca16db7de tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:31.057600 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-90cb02db-4ca9-4dd4-b26f-978ca16db7de tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.648278 Aug 30 01:03:31.061643 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 156/319] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:30 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:31.081409 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-d648c3a6-2088-476e-a691-fe7849ca4a53 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:31.103964 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-d648c3a6-2088-476e-a691-fe7849ca4a53 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.683625 Aug 30 01:03:31.106695 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 164/320] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:30 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:32.086869 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-8f3906ed-ea44-4264-8ebd-ae3d9ed05dd4 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:32.088103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-8f3906ed-ea44-4264-8ebd-ae3d9ed05dd4 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:32.099462 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f3906ed-ea44-4264-8ebd-ae3d9ed05dd4 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:32.104151 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f3906ed-ea44-4264-8ebd-ae3d9ed05dd4 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:32.104837 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f3906ed-ea44-4264-8ebd-ae3d9ed05dd4 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:32.110598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f3906ed-ea44-4264-8ebd-ae3d9ed05dd4 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:32.111299 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f3906ed-ea44-4264-8ebd-ae3d9ed05dd4 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:32.112070 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f3906ed-ea44-4264-8ebd-ae3d9ed05dd4 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:32.134183 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4656cb57-5f5a-4355-acb0-276da89c2149 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:32.135573 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-4656cb57-5f5a-4355-acb0-276da89c2149 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:32.154212 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4656cb57-5f5a-4355-acb0-276da89c2149 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:32.160343 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4656cb57-5f5a-4355-acb0-276da89c2149 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:32.162177 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4656cb57-5f5a-4355-acb0-276da89c2149 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:32.163353 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4656cb57-5f5a-4355-acb0-276da89c2149 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:32.165946 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4656cb57-5f5a-4355-acb0-276da89c2149 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:32.166618 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4656cb57-5f5a-4355-acb0-276da89c2149 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:32.429842 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-8f3906ed-ea44-4264-8ebd-ae3d9ed05dd4 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:32.440963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-8f3906ed-ea44-4264-8ebd-ae3d9ed05dd4 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.360187 Aug 30 01:03:32.441940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 157/321] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:32 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:32.509009 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-b843ddc1-6d5e-4899-b903-383d0a67cb57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-80923208", "imageRef": "d6c817b5-c41c-4210-a963-172386e2e582", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dffca817-1d31-4c9c-99a3-2d8483c143b4"}], "security_groups": [{"name": "tempest-securitygroup--1788648815"}], "key_name": "tempest-keypair-1827563118", "user_data": "}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:32.544428 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-4656cb57-5f5a-4355-acb0-276da89c2149 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:32.556721 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-4656cb57-5f5a-4355-acb0-276da89c2149 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.432293 Aug 30 01:03:32.557671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 165/322] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:32 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:33.469478 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-52b83508-e6d4-4dbf-9aac-bd8e50eb1acc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:33.470801 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-52b83508-e6d4-4dbf-9aac-bd8e50eb1acc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:33.478282 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-52b83508-e6d4-4dbf-9aac-bd8e50eb1acc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:33.478987 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-52b83508-e6d4-4dbf-9aac-bd8e50eb1acc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:33.479626 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-52b83508-e6d4-4dbf-9aac-bd8e50eb1acc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:33.487785 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-52b83508-e6d4-4dbf-9aac-bd8e50eb1acc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:33.488482 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-52b83508-e6d4-4dbf-9aac-bd8e50eb1acc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:33.489105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-52b83508-e6d4-4dbf-9aac-bd8e50eb1acc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:33.691997 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-52b83508-e6d4-4dbf-9aac-bd8e50eb1acc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:33.701990 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-52b83508-e6d4-4dbf-9aac-bd8e50eb1acc tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.242821 Aug 30 01:03:33.703216 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 166/323] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:33 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:33.708816 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-04ed811a-19bb-4f94-ab05-fd22b7590664 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:33.709861 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-04ed811a-19bb-4f94-ab05-fd22b7590664 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:33.720104 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-04ed811a-19bb-4f94-ab05-fd22b7590664 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:33.720930 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-04ed811a-19bb-4f94-ab05-fd22b7590664 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:33.721708 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-04ed811a-19bb-4f94-ab05-fd22b7590664 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:33.722657 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-04ed811a-19bb-4f94-ab05-fd22b7590664 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:33.723337 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-04ed811a-19bb-4f94-ab05-fd22b7590664 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:33.724499 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-04ed811a-19bb-4f94-ab05-fd22b7590664 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:33.927600 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-04ed811a-19bb-4f94-ab05-fd22b7590664 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:33.941560 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-04ed811a-19bb-4f94-ab05-fd22b7590664 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.235917 Aug 30 01:03:33.942515 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 167/324] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:33 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:34.242663 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.network.neutron [None req-b843ddc1-6d5e-4899-b903-383d0a67cb57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] validate_networks() for [('dffca817-1d31-4c9c-99a3-2d8483c143b4', None, None, None, None, None)] {{(pid=120631) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:03:34.725900 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-1f296fab-0125-45ba-9868-69284feb023f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:34.726568 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-1f296fab-0125-45ba-9868-69284feb023f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:34.736977 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1f296fab-0125-45ba-9868-69284feb023f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:34.737605 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1f296fab-0125-45ba-9868-69284feb023f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:34.738778 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1f296fab-0125-45ba-9868-69284feb023f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:34.739501 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1f296fab-0125-45ba-9868-69284feb023f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:34.739961 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1f296fab-0125-45ba-9868-69284feb023f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:34.740389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1f296fab-0125-45ba-9868-69284feb023f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:34.969682 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-b843ddc1-6d5e-4899-b903-383d0a67cb57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Flavor limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:03:34.971340 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-b843ddc1-6d5e-4899-b903-383d0a67cb57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Image limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:03:34.972009 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-b843ddc1-6d5e-4899-b903-383d0a67cb57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Flavor pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:03:34.972782 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-b843ddc1-6d5e-4899-b903-383d0a67cb57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Image pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:03:34.974052 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-b843ddc1-6d5e-4899-b903-383d0a67cb57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:03:34.981489 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-1f296fab-0125-45ba-9868-69284feb023f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:34.990027 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-1f296fab-0125-45ba-9868-69284feb023f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.268008 Aug 30 01:03:34.992483 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 168/325] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:34 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:34.996508 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b843ddc1-6d5e-4899-b903-383d0a67cb57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:34.997220 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b843ddc1-6d5e-4899-b903-383d0a67cb57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:34.997844 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-9f883477-2696-4299-b5bf-d2ce4ab3e480 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:34.998119 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b843ddc1-6d5e-4899-b903-383d0a67cb57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:34.998685 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-9f883477-2696-4299-b5bf-d2ce4ab3e480 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:34.999781 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b843ddc1-6d5e-4899-b903-383d0a67cb57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:35.000587 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b843ddc1-6d5e-4899-b903-383d0a67cb57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:35.001205 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b843ddc1-6d5e-4899-b903-383d0a67cb57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:35.005301 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9f883477-2696-4299-b5bf-d2ce4ab3e480 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:35.005801 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9f883477-2696-4299-b5bf-d2ce4ab3e480 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:35.006417 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9f883477-2696-4299-b5bf-d2ce4ab3e480 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:35.007149 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9f883477-2696-4299-b5bf-d2ce4ab3e480 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:35.007591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9f883477-2696-4299-b5bf-d2ce4ab3e480 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:35.008022 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9f883477-2696-4299-b5bf-d2ce4ab3e480 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:35.031718 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-b843ddc1-6d5e-4899-b903-383d0a67cb57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Getting quotas for project 0596692dbfb149139a1e72159c6f93db. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:03:35.036910 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-b843ddc1-6d5e-4899-b903-383d0a67cb57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Getting quotas for user cc7cf306aadb45d1b65252b53c86b612 and project 0596692dbfb149139a1e72159c6f93db. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:03:35.054295 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-b843ddc1-6d5e-4899-b903-383d0a67cb57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Going to run 1 instances... {{(pid=120631) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:03:35.060784 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-b843ddc1-6d5e-4899-b903-383d0a67cb57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6c817b5-c41c-4210-a963-172386e2e582',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120631) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:03:35.168961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-b843ddc1-6d5e-4899-b903-383d0a67cb57 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.665325 Aug 30 01:03:35.170760 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 158/326] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 30 01:03:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 2668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 01:03:35.186546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-ad039932-16aa-43e2-823d-0bbfd8fe9b1d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:35.189611 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-ad039932-16aa-43e2-823d-0bbfd8fe9b1d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:35.247254 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-9f883477-2696-4299-b5bf-d2ce4ab3e480 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:35.247254 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-9f883477-2696-4299-b5bf-d2ce4ab3e480 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.234225 Aug 30 01:03:35.247254 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 169/327] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:34 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:35.306494 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-ad039932-16aa-43e2-823d-0bbfd8fe9b1d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:35.321998 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-ad039932-16aa-43e2-823d-0bbfd8fe9b1d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 200 len: 1240 microversion: 2.1 time: 0.142759 Aug 30 01:03:35.323281 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 159/328] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:35 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 1240 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:36.010730 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-e5e68924-d5c2-473d-8377-840f4925c59a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:36.012098 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-e5e68924-d5c2-473d-8377-840f4925c59a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:36.019884 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e5e68924-d5c2-473d-8377-840f4925c59a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:36.020373 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e5e68924-d5c2-473d-8377-840f4925c59a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:36.020811 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e5e68924-d5c2-473d-8377-840f4925c59a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:36.021550 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e5e68924-d5c2-473d-8377-840f4925c59a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:36.021997 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e5e68924-d5c2-473d-8377-840f4925c59a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:36.022417 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e5e68924-d5c2-473d-8377-840f4925c59a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:36.244064 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-e5e68924-d5c2-473d-8377-840f4925c59a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:36.253918 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-6680d884-0bab-47b1-b03c-2c696767ac98 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:36.255102 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-6680d884-0bab-47b1-b03c-2c696767ac98 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:36.257213 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:36.262547 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-e5e68924-d5c2-473d-8377-840f4925c59a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.255461 Aug 30 01:03:36.263684 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 170/329] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:36 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:36.291398 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6680d884-0bab-47b1-b03c-2c696767ac98 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:36.292850 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6680d884-0bab-47b1-b03c-2c696767ac98 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:36.295293 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6680d884-0bab-47b1-b03c-2c696767ac98 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:36.297614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6680d884-0bab-47b1-b03c-2c696767ac98 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:36.298285 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6680d884-0bab-47b1-b03c-2c696767ac98 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:36.298864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6680d884-0bab-47b1-b03c-2c696767ac98 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:36.344480 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-9116c098-8e47-4cf0-9300-627e5f5d8c98 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:36.345119 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-9116c098-8e47-4cf0-9300-627e5f5d8c98 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:36.352507 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9116c098-8e47-4cf0-9300-627e5f5d8c98 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:36.353004 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9116c098-8e47-4cf0-9300-627e5f5d8c98 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:36.353479 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9116c098-8e47-4cf0-9300-627e5f5d8c98 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:36.358379 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9116c098-8e47-4cf0-9300-627e5f5d8c98 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:36.358864 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9116c098-8e47-4cf0-9300-627e5f5d8c98 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:36.359297 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9116c098-8e47-4cf0-9300-627e5f5d8c98 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:36.479120 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-9116c098-8e47-4cf0-9300-627e5f5d8c98 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:36.487447 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-9116c098-8e47-4cf0-9300-627e5f5d8c98 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 200 len: 1292 microversion: 2.1 time: 0.146918 Aug 30 01:03:36.501100 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 171/330] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:36 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 1292 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:36.514320 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6680d884-0bab-47b1-b03c-2c696767ac98 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:36.525825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-6680d884-0bab-47b1-b03c-2c696767ac98 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.275839 Aug 30 01:03:36.528072 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 160/331] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:36 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:37.284334 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8aca40f9-f7e5-4297-8059-951b5cfc4fae tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:37.285632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8aca40f9-f7e5-4297-8059-951b5cfc4fae tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:37.300226 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8aca40f9-f7e5-4297-8059-951b5cfc4fae tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:37.304460 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8aca40f9-f7e5-4297-8059-951b5cfc4fae tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:37.305187 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8aca40f9-f7e5-4297-8059-951b5cfc4fae tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:37.306627 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8aca40f9-f7e5-4297-8059-951b5cfc4fae tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:37.307262 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8aca40f9-f7e5-4297-8059-951b5cfc4fae tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:37.307702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8aca40f9-f7e5-4297-8059-951b5cfc4fae tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:37.509996 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-45acf99e-2cf8-4aae-a703-0e528bd61096 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:37.511290 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-45acf99e-2cf8-4aae-a703-0e528bd61096 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:37.520546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-45acf99e-2cf8-4aae-a703-0e528bd61096 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:37.521916 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-45acf99e-2cf8-4aae-a703-0e528bd61096 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:37.522776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-45acf99e-2cf8-4aae-a703-0e528bd61096 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:37.523641 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-45acf99e-2cf8-4aae-a703-0e528bd61096 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:37.524250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-45acf99e-2cf8-4aae-a703-0e528bd61096 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:37.525121 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-45acf99e-2cf8-4aae-a703-0e528bd61096 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:37.559378 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8aca40f9-f7e5-4297-8059-951b5cfc4fae tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:37.574282 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8aca40f9-f7e5-4297-8059-951b5cfc4fae tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.293950 Aug 30 01:03:37.578823 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 172/332] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:37 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:37.591705 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4d6f61e5-8bda-4f5f-986d-ab02ec46a24c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:37.593368 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-4d6f61e5-8bda-4f5f-986d-ab02ec46a24c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:37.601232 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4d6f61e5-8bda-4f5f-986d-ab02ec46a24c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:37.603520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4d6f61e5-8bda-4f5f-986d-ab02ec46a24c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:37.606215 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4d6f61e5-8bda-4f5f-986d-ab02ec46a24c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:37.607584 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4d6f61e5-8bda-4f5f-986d-ab02ec46a24c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:37.608138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4d6f61e5-8bda-4f5f-986d-ab02ec46a24c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:37.608636 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4d6f61e5-8bda-4f5f-986d-ab02ec46a24c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:37.921331 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-4d6f61e5-8bda-4f5f-986d-ab02ec46a24c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:37.931597 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-4d6f61e5-8bda-4f5f-986d-ab02ec46a24c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.351482 Aug 30 01:03:37.932175 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 173/333] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:37 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:37.957198 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-45acf99e-2cf8-4aae-a703-0e528bd61096 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:37.968981 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-45acf99e-2cf8-4aae-a703-0e528bd61096 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 200 len: 1366 microversion: 2.1 time: 0.462850 Aug 30 01:03:37.970195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 161/334] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:37 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 1366 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:38.598152 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-5ebb3e1f-022a-47b5-a1bb-41282fc6e985 req-e4305d75-169f-435c-9b5c-5cb438dbaa49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f9ce423-87fe-4742-ab18-537e725fb3c2", "tag": "f0e1db00-4448-4f4f-865f-c2f369d94a25"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:38.603834 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-408e063e-5901-458d-bb2b-0db855b3b162 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:38.607344 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-408e063e-5901-458d-bb2b-0db855b3b162 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:38.610383 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-5ebb3e1f-022a-47b5-a1bb-41282fc6e985 req-e4305d75-169f-435c-9b5c-5cb438dbaa49 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:38.610859 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-5ebb3e1f-022a-47b5-a1bb-41282fc6e985 req-e4305d75-169f-435c-9b5c-5cb438dbaa49 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:38.611460 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-5ebb3e1f-022a-47b5-a1bb-41282fc6e985 req-e4305d75-169f-435c-9b5c-5cb438dbaa49 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:38.620141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-408e063e-5901-458d-bb2b-0db855b3b162 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:38.621426 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-408e063e-5901-458d-bb2b-0db855b3b162 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:38.637877 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-408e063e-5901-458d-bb2b-0db855b3b162 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:38.638932 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-408e063e-5901-458d-bb2b-0db855b3b162 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:38.640661 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-408e063e-5901-458d-bb2b-0db855b3b162 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:38.641835 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-408e063e-5901-458d-bb2b-0db855b3b162 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:38.643100 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-5ebb3e1f-022a-47b5-a1bb-41282fc6e985 req-e4305d75-169f-435c-9b5c-5cb438dbaa49 service nova] Creating event network-changed:f0e1db00-4448-4f4f-865f-c2f369d94a25 for instance 0f9ce423-87fe-4742-ab18-537e725fb3c2 on hv-cinder-81514 Aug 30 01:03:38.651989 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-5ebb3e1f-022a-47b5-a1bb-41282fc6e985 req-e4305d75-169f-435c-9b5c-5cb438dbaa49 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057379 Aug 30 01:03:38.653151 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 174/335] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:38.923211 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-408e063e-5901-458d-bb2b-0db855b3b162 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:38.928308 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:38.938684 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-408e063e-5901-458d-bb2b-0db855b3b162 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.342208 Aug 30 01:03:38.939255 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 162/336] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:38 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:38.962201 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-c0b3d8e0-21ed-422b-b93c-292a9ee4ba9a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:38.965179 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-c0b3d8e0-21ed-422b-b93c-292a9ee4ba9a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:38.973930 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c0b3d8e0-21ed-422b-b93c-292a9ee4ba9a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:38.974637 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c0b3d8e0-21ed-422b-b93c-292a9ee4ba9a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:38.975487 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c0b3d8e0-21ed-422b-b93c-292a9ee4ba9a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:38.976638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c0b3d8e0-21ed-422b-b93c-292a9ee4ba9a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:38.977243 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c0b3d8e0-21ed-422b-b93c-292a9ee4ba9a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:38.977901 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c0b3d8e0-21ed-422b-b93c-292a9ee4ba9a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:38.994217 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-aebae77b-2313-42a6-a0aa-1fdb5dd2fb84 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:38.996158 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-aebae77b-2313-42a6-a0aa-1fdb5dd2fb84 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:39.011698 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-aebae77b-2313-42a6-a0aa-1fdb5dd2fb84 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:39.013678 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-aebae77b-2313-42a6-a0aa-1fdb5dd2fb84 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:39.014395 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-aebae77b-2313-42a6-a0aa-1fdb5dd2fb84 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:39.017560 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-aebae77b-2313-42a6-a0aa-1fdb5dd2fb84 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:39.018108 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-aebae77b-2313-42a6-a0aa-1fdb5dd2fb84 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:39.018563 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-aebae77b-2313-42a6-a0aa-1fdb5dd2fb84 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:39.298799 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-c0b3d8e0-21ed-422b-b93c-292a9ee4ba9a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:39.308949 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-c0b3d8e0-21ed-422b-b93c-292a9ee4ba9a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.350934 Aug 30 01:03:39.309928 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 175/337] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:38 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:39.314840 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-a52ae9ac-bb87-4f1c-8ade-62ba7b8e1822 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Action: 'create', calling method: .version_select at 0x7f0f52b31d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-569795229", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqi28AmGYfEFvfOku3a8NFp0Dy366PM7ulnY2l9tv4jlTXZfc6LspWPsIxibkpPjuTZ9on7LLlV0Krk9uC6U3B1cd0OWazbJH60lleYWN2XkvSrmnExlcPSV5VauaiwHQ=="}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:39.330972 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-a52ae9ac-bb87-4f1c-8ade-62ba7b8e1822 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Getting quotas for project fca43fd867154911badb413c7046befd. Resources: {'key_pairs'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:03:39.335065 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-a52ae9ac-bb87-4f1c-8ade-62ba7b8e1822 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Getting quotas for user 0aa5b198f4e14d52a369248f1e6c0f47 and project fca43fd867154911badb413c7046befd. Resources: {'key_pairs'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:03:39.337390 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-aebae77b-2313-42a6-a0aa-1fdb5dd2fb84 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:39.355199 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-aebae77b-2313-42a6-a0aa-1fdb5dd2fb84 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 200 len: 1366 microversion: 2.1 time: 0.363582 Aug 30 01:03:39.356270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 163/338] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:38 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 1366 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:39.372814 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-a52ae9ac-bb87-4f1c-8ade-62ba7b8e1822 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.062031 Aug 30 01:03:39.373750 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 176/339] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 30 01:03:39 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:39.488198 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-f39bbfa5-e3f2-4565-97b7-a5d6cdde0da0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1337655786", "imageRef": "d10acf69-6293-42c9-8d9c-0138cb25b3de", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-569795229", "networks": [{"uuid": "333b25f5-148a-49b1-825d-7793a1ea673e"}]}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:39.545065 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.network.neutron [None req-f39bbfa5-e3f2-4565-97b7-a5d6cdde0da0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] validate_networks() for [('333b25f5-148a-49b1-825d-7793a1ea673e', None, None, None, None, None)] {{(pid=120631) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:03:39.937501 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-f39bbfa5-e3f2-4565-97b7-a5d6cdde0da0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Flavor limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:03:39.938124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-f39bbfa5-e3f2-4565-97b7-a5d6cdde0da0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Image limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:03:39.938460 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-f39bbfa5-e3f2-4565-97b7-a5d6cdde0da0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Flavor pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:03:39.938779 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-f39bbfa5-e3f2-4565-97b7-a5d6cdde0da0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Image pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:03:39.939192 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-f39bbfa5-e3f2-4565-97b7-a5d6cdde0da0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:03:39.949645 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f39bbfa5-e3f2-4565-97b7-a5d6cdde0da0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:39.950186 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f39bbfa5-e3f2-4565-97b7-a5d6cdde0da0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:39.950622 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f39bbfa5-e3f2-4565-97b7-a5d6cdde0da0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:39.951492 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f39bbfa5-e3f2-4565-97b7-a5d6cdde0da0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:39.951993 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f39bbfa5-e3f2-4565-97b7-a5d6cdde0da0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:39.952419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f39bbfa5-e3f2-4565-97b7-a5d6cdde0da0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:39.963062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-b6a7f556-b5c1-4d25-a96c-fec288f3c159 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:39.965518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-b6a7f556-b5c1-4d25-a96c-fec288f3c159 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:39.986037 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-f39bbfa5-e3f2-4565-97b7-a5d6cdde0da0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Getting quotas for project fca43fd867154911badb413c7046befd. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:03:39.988123 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b6a7f556-b5c1-4d25-a96c-fec288f3c159 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:39.988913 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b6a7f556-b5c1-4d25-a96c-fec288f3c159 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:39.989686 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b6a7f556-b5c1-4d25-a96c-fec288f3c159 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:39.990361 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-f39bbfa5-e3f2-4565-97b7-a5d6cdde0da0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Getting quotas for user 0aa5b198f4e14d52a369248f1e6c0f47 and project fca43fd867154911badb413c7046befd. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:03:39.990468 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b6a7f556-b5c1-4d25-a96c-fec288f3c159 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:39.990979 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b6a7f556-b5c1-4d25-a96c-fec288f3c159 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:39.991570 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b6a7f556-b5c1-4d25-a96c-fec288f3c159 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:40.003465 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-f39bbfa5-e3f2-4565-97b7-a5d6cdde0da0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Going to run 1 instances... {{(pid=120631) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:03:40.005924 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-f39bbfa5-e3f2-4565-97b7-a5d6cdde0da0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10acf69-6293-42c9-8d9c-0138cb25b3de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120631) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:03:40.073130 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-f39bbfa5-e3f2-4565-97b7-a5d6cdde0da0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588640 Aug 30 01:03:40.073861 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 164/340] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 30 01:03:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:03:40.084472 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-2b888942-91e1-47c7-b01d-d4afbce4ec5c tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:40.085109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-2b888942-91e1-47c7-b01d-d4afbce4ec5c tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:40.178766 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-2b888942-91e1-47c7-b01d-d4afbce4ec5c tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:40.190509 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-2b888942-91e1-47c7-b01d-d4afbce4ec5c tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1258 microversion: 2.1 time: 0.109542 Aug 30 01:03:40.191098 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 165/341] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:40 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1258 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:40.223828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-b6a7f556-b5c1-4d25-a96c-fec288f3c159 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:40.235708 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-b6a7f556-b5c1-4d25-a96c-fec288f3c159 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.277639 Aug 30 01:03:40.237960 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 177/342] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:39 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:40.331980 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3964cc2b-eb68-4073-bc97-563f5477490d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:40.332610 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-3964cc2b-eb68-4073-bc97-563f5477490d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:40.350167 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3964cc2b-eb68-4073-bc97-563f5477490d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:40.351204 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3964cc2b-eb68-4073-bc97-563f5477490d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:40.352943 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3964cc2b-eb68-4073-bc97-563f5477490d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:40.353993 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3964cc2b-eb68-4073-bc97-563f5477490d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:40.355854 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3964cc2b-eb68-4073-bc97-563f5477490d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:40.357338 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3964cc2b-eb68-4073-bc97-563f5477490d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:40.380695 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-352ae0e6-786d-4e44-8e50-2f7c3393bd56 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:40.381611 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-352ae0e6-786d-4e44-8e50-2f7c3393bd56 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:40.395410 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-352ae0e6-786d-4e44-8e50-2f7c3393bd56 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:40.397562 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-352ae0e6-786d-4e44-8e50-2f7c3393bd56 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:40.401111 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-352ae0e6-786d-4e44-8e50-2f7c3393bd56 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:40.402463 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-352ae0e6-786d-4e44-8e50-2f7c3393bd56 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:40.402933 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-352ae0e6-786d-4e44-8e50-2f7c3393bd56 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:40.405463 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-352ae0e6-786d-4e44-8e50-2f7c3393bd56 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:41.013049 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-352ae0e6-786d-4e44-8e50-2f7c3393bd56 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:41.021538 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-352ae0e6-786d-4e44-8e50-2f7c3393bd56 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 200 len: 1366 microversion: 2.1 time: 0.648944 Aug 30 01:03:41.022109 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 178/343] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:40 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 1366 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:41.025796 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3964cc2b-eb68-4073-bc97-563f5477490d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:41.037592 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3964cc2b-eb68-4073-bc97-563f5477490d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.710590 Aug 30 01:03:41.038225 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 166/344] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:40 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:41.211690 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-6b475144-aa83-4ca5-b316-12472b5bfa90 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:41.212300 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-6b475144-aa83-4ca5-b316-12472b5bfa90 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:41.219524 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6b475144-aa83-4ca5-b316-12472b5bfa90 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:41.220011 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6b475144-aa83-4ca5-b316-12472b5bfa90 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:41.220448 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6b475144-aa83-4ca5-b316-12472b5bfa90 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:41.221176 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6b475144-aa83-4ca5-b316-12472b5bfa90 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:41.221634 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6b475144-aa83-4ca5-b316-12472b5bfa90 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:41.222059 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6b475144-aa83-4ca5-b316-12472b5bfa90 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:41.258810 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e733c226-568e-4b76-983e-57723a743d92 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:41.259423 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e733c226-568e-4b76-983e-57723a743d92 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:41.266006 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e733c226-568e-4b76-983e-57723a743d92 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:41.266500 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e733c226-568e-4b76-983e-57723a743d92 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:41.266936 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e733c226-568e-4b76-983e-57723a743d92 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:41.267671 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e733c226-568e-4b76-983e-57723a743d92 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:41.268131 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e733c226-568e-4b76-983e-57723a743d92 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:41.268558 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e733c226-568e-4b76-983e-57723a743d92 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:41.286900 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-6b475144-aa83-4ca5-b316-12472b5bfa90 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:41.298303 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-6b475144-aa83-4ca5-b316-12472b5bfa90 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1310 microversion: 2.1 time: 0.090394 Aug 30 01:03:41.299878 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 179/345] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:41 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1310 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:41.458806 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e733c226-568e-4b76-983e-57723a743d92 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:41.469893 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e733c226-568e-4b76-983e-57723a743d92 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.214339 Aug 30 01:03:41.470404 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 167/346] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:41 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:42.042901 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-9dce9908-5a81-4c08-a20f-0269e7a3eeeb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:42.044093 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-9dce9908-5a81-4c08-a20f-0269e7a3eeeb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:42.060399 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-f323eac9-c12e-4d2f-a786-80dfa549e1de tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:42.061639 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-f323eac9-c12e-4d2f-a786-80dfa549e1de tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:42.069937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9dce9908-5a81-4c08-a20f-0269e7a3eeeb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:42.070431 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9dce9908-5a81-4c08-a20f-0269e7a3eeeb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:42.074002 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f323eac9-c12e-4d2f-a786-80dfa549e1de tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:42.074361 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f323eac9-c12e-4d2f-a786-80dfa549e1de tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:42.074858 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f323eac9-c12e-4d2f-a786-80dfa549e1de tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:42.075706 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f323eac9-c12e-4d2f-a786-80dfa549e1de tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:42.075949 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9dce9908-5a81-4c08-a20f-0269e7a3eeeb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:42.076863 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9dce9908-5a81-4c08-a20f-0269e7a3eeeb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:42.077394 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9dce9908-5a81-4c08-a20f-0269e7a3eeeb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:42.077853 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9dce9908-5a81-4c08-a20f-0269e7a3eeeb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:42.085303 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f323eac9-c12e-4d2f-a786-80dfa549e1de tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:42.085770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f323eac9-c12e-4d2f-a786-80dfa549e1de tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:42.482723 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-9dce9908-5a81-4c08-a20f-0269e7a3eeeb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:42.495816 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-f323eac9-c12e-4d2f-a786-80dfa549e1de tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:42.507208 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-9dce9908-5a81-4c08-a20f-0269e7a3eeeb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 200 len: 1366 microversion: 2.1 time: 0.468317 Aug 30 01:03:42.508083 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 180/347] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:42 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 1366 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:42.512847 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-f323eac9-c12e-4d2f-a786-80dfa549e1de tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.456750 Aug 30 01:03:42.524838 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-ca5c5781-ef5a-433c-a83b-a7f0738fe7fd tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:42.524838 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-ca5c5781-ef5a-433c-a83b-a7f0738fe7fd tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:42.533094 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 168/348] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:42 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:42.538116 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-6bb2fa3d-952d-4637-9fa2-0d556b6191b5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:42.538970 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-6bb2fa3d-952d-4637-9fa2-0d556b6191b5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:42.548941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ca5c5781-ef5a-433c-a83b-a7f0738fe7fd tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:42.549573 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ca5c5781-ef5a-433c-a83b-a7f0738fe7fd tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:42.550103 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ca5c5781-ef5a-433c-a83b-a7f0738fe7fd tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:42.551073 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ca5c5781-ef5a-433c-a83b-a7f0738fe7fd tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:42.551876 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ca5c5781-ef5a-433c-a83b-a7f0738fe7fd tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:42.552525 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ca5c5781-ef5a-433c-a83b-a7f0738fe7fd tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:42.553657 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6bb2fa3d-952d-4637-9fa2-0d556b6191b5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:42.554172 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6bb2fa3d-952d-4637-9fa2-0d556b6191b5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:42.554614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6bb2fa3d-952d-4637-9fa2-0d556b6191b5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:42.555329 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6bb2fa3d-952d-4637-9fa2-0d556b6191b5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:42.555859 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6bb2fa3d-952d-4637-9fa2-0d556b6191b5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:42.556294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6bb2fa3d-952d-4637-9fa2-0d556b6191b5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:42.931484 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-ca5c5781-ef5a-433c-a83b-a7f0738fe7fd tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:42.942123 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-ca5c5781-ef5a-433c-a83b-a7f0738fe7fd tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1358 microversion: 2.1 time: 0.431964 Aug 30 01:03:42.946018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 181/349] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:42 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1358 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:42.977439 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6bb2fa3d-952d-4637-9fa2-0d556b6191b5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:42.988100 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-6bb2fa3d-952d-4637-9fa2-0d556b6191b5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.453648 Aug 30 01:03:43.005907 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 169/350] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:42 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:43.530007 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-2c7d95c7-ca35-465a-8aee-9e88f6aa23c5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:43.531459 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-2c7d95c7-ca35-465a-8aee-9e88f6aa23c5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:43.541295 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-b2929566-dd3d-40fe-b2e5-8b7bbb14d86a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:43.542700 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2c7d95c7-ca35-465a-8aee-9e88f6aa23c5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:43.543035 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-b2929566-dd3d-40fe-b2e5-8b7bbb14d86a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:43.546344 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2c7d95c7-ca35-465a-8aee-9e88f6aa23c5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:43.547115 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2c7d95c7-ca35-465a-8aee-9e88f6aa23c5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:43.548328 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2c7d95c7-ca35-465a-8aee-9e88f6aa23c5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:43.549030 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2c7d95c7-ca35-465a-8aee-9e88f6aa23c5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:43.549686 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2c7d95c7-ca35-465a-8aee-9e88f6aa23c5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:43.556479 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b2929566-dd3d-40fe-b2e5-8b7bbb14d86a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:43.557451 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b2929566-dd3d-40fe-b2e5-8b7bbb14d86a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:43.559666 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b2929566-dd3d-40fe-b2e5-8b7bbb14d86a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:43.561604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b2929566-dd3d-40fe-b2e5-8b7bbb14d86a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:43.562166 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b2929566-dd3d-40fe-b2e5-8b7bbb14d86a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:43.562615 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b2929566-dd3d-40fe-b2e5-8b7bbb14d86a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:43.814283 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-2c7d95c7-ca35-465a-8aee-9e88f6aa23c5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:43.818281 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=100 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:43.821747 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-b2929566-dd3d-40fe-b2e5-8b7bbb14d86a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:43.824203 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-2c7d95c7-ca35-465a-8aee-9e88f6aa23c5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 200 len: 1366 microversion: 2.1 time: 0.300236 Aug 30 01:03:43.833271 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-b2929566-dd3d-40fe-b2e5-8b7bbb14d86a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.297084 Aug 30 01:03:43.839759 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 182/351] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:43 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:43.848453 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 170/352] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:43 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:43.968783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-d115a9fc-b68b-40af-8821-4588ad832a60 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:43.970009 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-d115a9fc-b68b-40af-8821-4588ad832a60 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:43.977261 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d115a9fc-b68b-40af-8821-4588ad832a60 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:43.977842 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d115a9fc-b68b-40af-8821-4588ad832a60 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:43.978373 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d115a9fc-b68b-40af-8821-4588ad832a60 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:43.979080 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d115a9fc-b68b-40af-8821-4588ad832a60 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:43.979679 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d115a9fc-b68b-40af-8821-4588ad832a60 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:43.980557 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d115a9fc-b68b-40af-8821-4588ad832a60 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:44.011486 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-7175a19c-3b33-48d0-9bf9-9ddc5cf8b5a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:44.012468 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-7175a19c-3b33-48d0-9bf9-9ddc5cf8b5a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:44.022274 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7175a19c-3b33-48d0-9bf9-9ddc5cf8b5a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:44.022863 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7175a19c-3b33-48d0-9bf9-9ddc5cf8b5a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:44.023371 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7175a19c-3b33-48d0-9bf9-9ddc5cf8b5a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:44.024151 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7175a19c-3b33-48d0-9bf9-9ddc5cf8b5a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:44.024699 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7175a19c-3b33-48d0-9bf9-9ddc5cf8b5a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:44.025234 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7175a19c-3b33-48d0-9bf9-9ddc5cf8b5a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:44.221939 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-d115a9fc-b68b-40af-8821-4588ad832a60 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:44.236592 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-d115a9fc-b68b-40af-8821-4588ad832a60 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1358 microversion: 2.1 time: 0.273033 Aug 30 01:03:44.237202 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 183/353] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:43 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:44.266758 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-7175a19c-3b33-48d0-9bf9-9ddc5cf8b5a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:44.282395 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-7175a19c-3b33-48d0-9bf9-9ddc5cf8b5a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.275927 Aug 30 01:03:44.282971 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 171/354] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:44 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:44.846299 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4871da8c-8b87-4f3b-8701-56aee065aa44 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:44.847021 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-4871da8c-8b87-4f3b-8701-56aee065aa44 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:44.856714 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-2d7d5daf-7e7e-4adc-9ba9-66437b737468 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:44.857439 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-2d7d5daf-7e7e-4adc-9ba9-66437b737468 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:44.860675 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4871da8c-8b87-4f3b-8701-56aee065aa44 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:44.861300 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4871da8c-8b87-4f3b-8701-56aee065aa44 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:44.862633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4871da8c-8b87-4f3b-8701-56aee065aa44 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:44.863707 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4871da8c-8b87-4f3b-8701-56aee065aa44 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:44.864365 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4871da8c-8b87-4f3b-8701-56aee065aa44 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:44.865517 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4871da8c-8b87-4f3b-8701-56aee065aa44 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:44.867323 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2d7d5daf-7e7e-4adc-9ba9-66437b737468 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:44.867818 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2d7d5daf-7e7e-4adc-9ba9-66437b737468 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:44.869871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2d7d5daf-7e7e-4adc-9ba9-66437b737468 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:44.871295 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2d7d5daf-7e7e-4adc-9ba9-66437b737468 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:44.873487 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2d7d5daf-7e7e-4adc-9ba9-66437b737468 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:44.873968 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2d7d5daf-7e7e-4adc-9ba9-66437b737468 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:45.127858 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-4871da8c-8b87-4f3b-8701-56aee065aa44 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:45.131220 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-2d7d5daf-7e7e-4adc-9ba9-66437b737468 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:45.143895 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-2d7d5daf-7e7e-4adc-9ba9-66437b737468 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.292182 Aug 30 01:03:45.144689 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 172/355] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:44 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:45.146567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-4871da8c-8b87-4f3b-8701-56aee065aa44 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 200 len: 1366 microversion: 2.1 time: 0.303858 Aug 30 01:03:45.157104 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-6f3660b8-8a86-4b36-91fe-e3c76fbd59e9 req-621a476e-1dd1-497d-a639-28d9c792e5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9ce423-87fe-4742-ab18-537e725fb3c2", "name": "network-vif-plugged", "status": "completed", "tag": "f0e1db00-4448-4f4f-865f-c2f369d94a25"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:45.158139 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 184/356] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:44 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:45.160034 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-6f3660b8-8a86-4b36-91fe-e3c76fbd59e9 req-621a476e-1dd1-497d-a639-28d9c792e5d3 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:45.160515 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-6f3660b8-8a86-4b36-91fe-e3c76fbd59e9 req-621a476e-1dd1-497d-a639-28d9c792e5d3 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:45.160949 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-6f3660b8-8a86-4b36-91fe-e3c76fbd59e9 req-621a476e-1dd1-497d-a639-28d9c792e5d3 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:45.174529 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-6f3660b8-8a86-4b36-91fe-e3c76fbd59e9 req-621a476e-1dd1-497d-a639-28d9c792e5d3 service nova] Creating event network-vif-plugged:f0e1db00-4448-4f4f-865f-c2f369d94a25 for instance 0f9ce423-87fe-4742-ab18-537e725fb3c2 on hv-cinder-81514 Aug 30 01:03:45.178962 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-6f3660b8-8a86-4b36-91fe-e3c76fbd59e9 req-621a476e-1dd1-497d-a639-28d9c792e5d3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033361 Aug 30 01:03:45.179562 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 173/357] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:45.266100 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-6d198a53-d38f-4b2b-994c-9e27a824ffd3 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:45.266708 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-6d198a53-d38f-4b2b-994c-9e27a824ffd3 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:45.268517 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=2 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:45.274878 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6d198a53-d38f-4b2b-994c-9e27a824ffd3 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:45.275365 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6d198a53-d38f-4b2b-994c-9e27a824ffd3 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:45.275803 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6d198a53-d38f-4b2b-994c-9e27a824ffd3 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:45.277369 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6d198a53-d38f-4b2b-994c-9e27a824ffd3 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:45.278118 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6d198a53-d38f-4b2b-994c-9e27a824ffd3 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:45.279116 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6d198a53-d38f-4b2b-994c-9e27a824ffd3 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:45.304107 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-c755d0ae-8aab-4f7b-bd94-9a230346e18c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:45.304804 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-c755d0ae-8aab-4f7b-bd94-9a230346e18c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:45.312558 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c755d0ae-8aab-4f7b-bd94-9a230346e18c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:45.324835 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c755d0ae-8aab-4f7b-bd94-9a230346e18c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:45.325379 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c755d0ae-8aab-4f7b-bd94-9a230346e18c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:45.326154 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c755d0ae-8aab-4f7b-bd94-9a230346e18c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:45.326633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c755d0ae-8aab-4f7b-bd94-9a230346e18c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:45.327066 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c755d0ae-8aab-4f7b-bd94-9a230346e18c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:45.473614 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-6d198a53-d38f-4b2b-994c-9e27a824ffd3 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:45.489528 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-6d198a53-d38f-4b2b-994c-9e27a824ffd3 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1358 microversion: 2.1 time: 0.226997 Aug 30 01:03:45.490268 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 185/358] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:45 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:45.572325 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-c755d0ae-8aab-4f7b-bd94-9a230346e18c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:45.590182 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-c755d0ae-8aab-4f7b-bd94-9a230346e18c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.289044 Aug 30 01:03:45.607522 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 174/359] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:45 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:46.171430 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-97a44be9-0f8c-41ca-9c5d-79f214319d97 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:46.173854 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-246fea47-150c-4b17-9346-f1afc7ebbce3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:46.175653 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-246fea47-150c-4b17-9346-f1afc7ebbce3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:46.175851 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-97a44be9-0f8c-41ca-9c5d-79f214319d97 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:46.183648 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-97a44be9-0f8c-41ca-9c5d-79f214319d97 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:46.184069 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-246fea47-150c-4b17-9346-f1afc7ebbce3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:46.184498 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-97a44be9-0f8c-41ca-9c5d-79f214319d97 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:46.185008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-97a44be9-0f8c-41ca-9c5d-79f214319d97 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:46.185214 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-246fea47-150c-4b17-9346-f1afc7ebbce3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:46.185936 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-246fea47-150c-4b17-9346-f1afc7ebbce3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:46.186303 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-97a44be9-0f8c-41ca-9c5d-79f214319d97 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:46.186823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-97a44be9-0f8c-41ca-9c5d-79f214319d97 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:46.187374 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-97a44be9-0f8c-41ca-9c5d-79f214319d97 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:46.188176 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-246fea47-150c-4b17-9346-f1afc7ebbce3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:46.188979 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-246fea47-150c-4b17-9346-f1afc7ebbce3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:46.189799 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-246fea47-150c-4b17-9346-f1afc7ebbce3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:46.455645 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-97a44be9-0f8c-41ca-9c5d-79f214319d97 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:46.470824 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-97a44be9-0f8c-41ca-9c5d-79f214319d97 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 200 len: 1366 microversion: 2.1 time: 0.305220 Aug 30 01:03:46.474136 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 175/360] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:46 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:46.486315 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-246fea47-150c-4b17-9346-f1afc7ebbce3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:46.500860 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-246fea47-150c-4b17-9346-f1afc7ebbce3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.331157 Aug 30 01:03:46.501940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 186/361] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:46 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:46.518276 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-610b41d7-21f6-40f0-ab4e-4cdbcc6fc313 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:46.519030 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-610b41d7-21f6-40f0-ab4e-4cdbcc6fc313 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:46.528008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-610b41d7-21f6-40f0-ab4e-4cdbcc6fc313 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:46.529035 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-610b41d7-21f6-40f0-ab4e-4cdbcc6fc313 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:46.529820 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-610b41d7-21f6-40f0-ab4e-4cdbcc6fc313 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:46.531366 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-610b41d7-21f6-40f0-ab4e-4cdbcc6fc313 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:46.532256 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-610b41d7-21f6-40f0-ab4e-4cdbcc6fc313 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:46.532843 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-610b41d7-21f6-40f0-ab4e-4cdbcc6fc313 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:46.623148 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-148da4f3-ff37-4e63-bb09-9ad85fd7feb2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:46.624324 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-148da4f3-ff37-4e63-bb09-9ad85fd7feb2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:46.633879 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-148da4f3-ff37-4e63-bb09-9ad85fd7feb2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:46.635012 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-148da4f3-ff37-4e63-bb09-9ad85fd7feb2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:46.637681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-148da4f3-ff37-4e63-bb09-9ad85fd7feb2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:46.638676 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-148da4f3-ff37-4e63-bb09-9ad85fd7feb2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:46.639808 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-148da4f3-ff37-4e63-bb09-9ad85fd7feb2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:46.641253 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-148da4f3-ff37-4e63-bb09-9ad85fd7feb2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:46.734932 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-610b41d7-21f6-40f0-ab4e-4cdbcc6fc313 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:46.748500 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-610b41d7-21f6-40f0-ab4e-4cdbcc6fc313 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1358 microversion: 2.1 time: 0.234458 Aug 30 01:03:46.749195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 176/362] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:46 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:46.899574 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-148da4f3-ff37-4e63-bb09-9ad85fd7feb2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:46.908757 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-148da4f3-ff37-4e63-bb09-9ad85fd7feb2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.290673 Aug 30 01:03:46.921104 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 187/363] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:46 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:47.495122 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-8a9ce236-99bd-48fc-add0-97806d49783d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:47.496151 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-8a9ce236-99bd-48fc-add0-97806d49783d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:47.503574 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8a9ce236-99bd-48fc-add0-97806d49783d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:47.504312 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8a9ce236-99bd-48fc-add0-97806d49783d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:47.504752 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8a9ce236-99bd-48fc-add0-97806d49783d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:47.505486 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8a9ce236-99bd-48fc-add0-97806d49783d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:47.505943 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8a9ce236-99bd-48fc-add0-97806d49783d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:47.506376 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8a9ce236-99bd-48fc-add0-97806d49783d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:47.523896 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-071ac4e1-5208-49a3-9195-cfde3065d449 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:47.525482 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-071ac4e1-5208-49a3-9195-cfde3065d449 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:47.544106 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-071ac4e1-5208-49a3-9195-cfde3065d449 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:47.545908 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-071ac4e1-5208-49a3-9195-cfde3065d449 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:47.547702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-071ac4e1-5208-49a3-9195-cfde3065d449 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:47.553736 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-071ac4e1-5208-49a3-9195-cfde3065d449 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:47.554443 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-071ac4e1-5208-49a3-9195-cfde3065d449 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:47.554998 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-071ac4e1-5208-49a3-9195-cfde3065d449 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:47.791140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-8a9ce236-99bd-48fc-add0-97806d49783d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:47.801050 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-8a9ce236-99bd-48fc-add0-97806d49783d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 200 len: 1366 microversion: 2.1 time: 0.309799 Aug 30 01:03:47.829805 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 177/364] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:47 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:47.835271 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e6994b18-99ed-4d33-8847-8606b8f85560 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:47.839673 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e6994b18-99ed-4d33-8847-8606b8f85560 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:47.856864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e6994b18-99ed-4d33-8847-8606b8f85560 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:47.857890 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e6994b18-99ed-4d33-8847-8606b8f85560 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:47.858945 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e6994b18-99ed-4d33-8847-8606b8f85560 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:47.860114 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e6994b18-99ed-4d33-8847-8606b8f85560 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:47.861569 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e6994b18-99ed-4d33-8847-8606b8f85560 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:47.862318 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e6994b18-99ed-4d33-8847-8606b8f85560 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:47.939954 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-071ac4e1-5208-49a3-9195-cfde3065d449 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:47.949345 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-071ac4e1-5208-49a3-9195-cfde3065d449 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.430527 Aug 30 01:03:47.954112 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 188/365] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:47 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:47.962295 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-d35f2306-a863-42ee-bb20-719429722b13 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:47.969486 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-d35f2306-a863-42ee-bb20-719429722b13 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:47.976737 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d35f2306-a863-42ee-bb20-719429722b13 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:47.977947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d35f2306-a863-42ee-bb20-719429722b13 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:47.978699 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d35f2306-a863-42ee-bb20-719429722b13 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:47.980924 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d35f2306-a863-42ee-bb20-719429722b13 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:47.981627 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d35f2306-a863-42ee-bb20-719429722b13 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:47.982252 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d35f2306-a863-42ee-bb20-719429722b13 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:48.109051 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e6994b18-99ed-4d33-8847-8606b8f85560 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:48.118394 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e6994b18-99ed-4d33-8847-8606b8f85560 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1358 microversion: 2.1 time: 0.287102 Aug 30 01:03:48.119269 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 178/366] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:47 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1358 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:48.194136 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-d35f2306-a863-42ee-bb20-719429722b13 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:48.205986 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-d35f2306-a863-42ee-bb20-719429722b13 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.247443 Aug 30 01:03:48.206899 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 189/367] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:47 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:48.839157 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-efc89e3a-1149-4c89-85f3-b5bf0f32f910 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:48.840984 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-efc89e3a-1149-4c89-85f3-b5bf0f32f910 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:48.849009 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-efc89e3a-1149-4c89-85f3-b5bf0f32f910 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:48.849873 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-efc89e3a-1149-4c89-85f3-b5bf0f32f910 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:48.850504 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-efc89e3a-1149-4c89-85f3-b5bf0f32f910 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:48.851402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-efc89e3a-1149-4c89-85f3-b5bf0f32f910 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:48.852106 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-efc89e3a-1149-4c89-85f3-b5bf0f32f910 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:48.853231 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-efc89e3a-1149-4c89-85f3-b5bf0f32f910 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:48.979049 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-7a70dc6f-a72a-4f46-97b1-e3d5d57b6b4d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:48.981029 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-7a70dc6f-a72a-4f46-97b1-e3d5d57b6b4d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:48.987567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7a70dc6f-a72a-4f46-97b1-e3d5d57b6b4d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:48.988306 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7a70dc6f-a72a-4f46-97b1-e3d5d57b6b4d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:48.988918 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7a70dc6f-a72a-4f46-97b1-e3d5d57b6b4d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:48.989835 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7a70dc6f-a72a-4f46-97b1-e3d5d57b6b4d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:48.990294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7a70dc6f-a72a-4f46-97b1-e3d5d57b6b4d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:48.990725 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7a70dc6f-a72a-4f46-97b1-e3d5d57b6b4d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:49.217563 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-efc89e3a-1149-4c89-85f3-b5bf0f32f910 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:49.230392 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-efc89e3a-1149-4c89-85f3-b5bf0f32f910 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 200 len: 1366 microversion: 2.1 time: 0.396628 Aug 30 01:03:49.247962 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 179/368] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:48 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 1366 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:49.254721 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-cdcafdb4-4969-4409-a119-fc394a0f8164 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:49.255598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-cdcafdb4-4969-4409-a119-fc394a0f8164 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:49.264531 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cdcafdb4-4969-4409-a119-fc394a0f8164 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:49.265963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cdcafdb4-4969-4409-a119-fc394a0f8164 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:49.266637 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cdcafdb4-4969-4409-a119-fc394a0f8164 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:49.267626 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cdcafdb4-4969-4409-a119-fc394a0f8164 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:49.268472 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cdcafdb4-4969-4409-a119-fc394a0f8164 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:49.269126 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cdcafdb4-4969-4409-a119-fc394a0f8164 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:49.275157 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7a70dc6f-a72a-4f46-97b1-e3d5d57b6b4d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:49.287579 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-7a70dc6f-a72a-4f46-97b1-e3d5d57b6b4d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.312871 Aug 30 01:03:49.303607 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 190/369] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:48 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:49.317392 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-65f86347-ff57-4972-ad08-bd0d2cb3afe9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:49.322262 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-65f86347-ff57-4972-ad08-bd0d2cb3afe9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:49.336571 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-65f86347-ff57-4972-ad08-bd0d2cb3afe9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:49.340001 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-65f86347-ff57-4972-ad08-bd0d2cb3afe9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:49.342205 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-65f86347-ff57-4972-ad08-bd0d2cb3afe9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:49.343185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-65f86347-ff57-4972-ad08-bd0d2cb3afe9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:49.346240 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-65f86347-ff57-4972-ad08-bd0d2cb3afe9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:49.348171 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-65f86347-ff57-4972-ad08-bd0d2cb3afe9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:49.349640 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=8 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:49.904236 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-cdcafdb4-4969-4409-a119-fc394a0f8164 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:49.912266 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-cdcafdb4-4969-4409-a119-fc394a0f8164 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1358 microversion: 2.1 time: 0.662927 Aug 30 01:03:49.912938 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 180/370] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:49 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1358 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:49.956220 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-65f86347-ff57-4972-ad08-bd0d2cb3afe9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:49.965311 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-65f86347-ff57-4972-ad08-bd0d2cb3afe9 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.658400 Aug 30 01:03:49.977110 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 191/371] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:49 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:50.254891 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-2b32a5cb-b43e-408a-8da5-2166406fce2d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:50.255792 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-2b32a5cb-b43e-408a-8da5-2166406fce2d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:50.264683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=4 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:50.265684 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=16 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:50.279291 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2b32a5cb-b43e-408a-8da5-2166406fce2d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:50.279806 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2b32a5cb-b43e-408a-8da5-2166406fce2d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:50.280250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2b32a5cb-b43e-408a-8da5-2166406fce2d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:50.280977 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2b32a5cb-b43e-408a-8da5-2166406fce2d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:50.281488 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2b32a5cb-b43e-408a-8da5-2166406fce2d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:50.281915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2b32a5cb-b43e-408a-8da5-2166406fce2d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:50.314650 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f0c07ee1-dc55-43f8-a18d-3f30adeddadd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:50.315420 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-f0c07ee1-dc55-43f8-a18d-3f30adeddadd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:50.324285 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f0c07ee1-dc55-43f8-a18d-3f30adeddadd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:50.324918 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f0c07ee1-dc55-43f8-a18d-3f30adeddadd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:50.325581 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f0c07ee1-dc55-43f8-a18d-3f30adeddadd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:50.326999 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f0c07ee1-dc55-43f8-a18d-3f30adeddadd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:50.327578 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f0c07ee1-dc55-43f8-a18d-3f30adeddadd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:50.328238 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f0c07ee1-dc55-43f8-a18d-3f30adeddadd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:50.679540 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-2b32a5cb-b43e-408a-8da5-2166406fce2d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:50.684301 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=100 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:50.694525 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-2b32a5cb-b43e-408a-8da5-2166406fce2d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 200 len: 1366 microversion: 2.1 time: 0.443521 Aug 30 01:03:50.701717 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 181/372] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:50 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 1366 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:50.754490 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-f0c07ee1-dc55-43f8-a18d-3f30adeddadd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:50.763735 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-f0c07ee1-dc55-43f8-a18d-3f30adeddadd tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.453260 Aug 30 01:03:50.764295 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 192/373] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:50 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:50.936699 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-2ef67426-2078-4996-9acb-8fd1ac67dde1 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:50.937348 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-2ef67426-2078-4996-9acb-8fd1ac67dde1 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:50.945153 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2ef67426-2078-4996-9acb-8fd1ac67dde1 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:50.945656 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2ef67426-2078-4996-9acb-8fd1ac67dde1 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:50.946265 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2ef67426-2078-4996-9acb-8fd1ac67dde1 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:50.947402 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2ef67426-2078-4996-9acb-8fd1ac67dde1 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:50.948894 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2ef67426-2078-4996-9acb-8fd1ac67dde1 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:50.949529 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2ef67426-2078-4996-9acb-8fd1ac67dde1 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:50.987445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-b2a77b73-5322-435f-86e4-238dc20a28e8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:50.987966 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-b2a77b73-5322-435f-86e4-238dc20a28e8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:50.995144 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b2a77b73-5322-435f-86e4-238dc20a28e8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:50.995862 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b2a77b73-5322-435f-86e4-238dc20a28e8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:50.996312 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b2a77b73-5322-435f-86e4-238dc20a28e8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:50.997023 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b2a77b73-5322-435f-86e4-238dc20a28e8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:50.997694 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b2a77b73-5322-435f-86e4-238dc20a28e8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:50.998121 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b2a77b73-5322-435f-86e4-238dc20a28e8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:51.268422 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-2ef67426-2078-4996-9acb-8fd1ac67dde1 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:51.276231 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-2ef67426-2078-4996-9acb-8fd1ac67dde1 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1358 microversion: 2.1 time: 0.345466 Aug 30 01:03:51.276834 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 182/374] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:50 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1358 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:51.315590 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-b2a77b73-5322-435f-86e4-238dc20a28e8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:51.324631 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-b2a77b73-5322-435f-86e4-238dc20a28e8 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.341020 Aug 30 01:03:51.325565 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 193/375] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:50 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:51.683507 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-00ecc60e-46bf-4ee0-af83-1553fffa99c0 req-ef3bffdb-7205-4667-a6ff-b0033f7dc21e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5598be2a-00db-4303-bc81-a7fb3674e371", "tag": "e2481fa1-2595-4100-98cf-07e796517813"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:51.697647 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-00ecc60e-46bf-4ee0-af83-1553fffa99c0 req-ef3bffdb-7205-4667-a6ff-b0033f7dc21e service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:51.698598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-00ecc60e-46bf-4ee0-af83-1553fffa99c0 req-ef3bffdb-7205-4667-a6ff-b0033f7dc21e service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:51.699230 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-00ecc60e-46bf-4ee0-af83-1553fffa99c0 req-ef3bffdb-7205-4667-a6ff-b0033f7dc21e service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:51.711785 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-00ecc60e-46bf-4ee0-af83-1553fffa99c0 req-ef3bffdb-7205-4667-a6ff-b0033f7dc21e service nova] Creating event network-changed:e2481fa1-2595-4100-98cf-07e796517813 for instance 5598be2a-00db-4303-bc81-a7fb3674e371 on hv-cinder-81514 Aug 30 01:03:51.720736 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-00ecc60e-46bf-4ee0-af83-1553fffa99c0 req-ef3bffdb-7205-4667-a6ff-b0033f7dc21e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041511 Aug 30 01:03:51.721713 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 183/376] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:51.722347 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-5c1b136c-ef4f-45d7-a874-07f6cb1b904e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:51.723030 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-5c1b136c-ef4f-45d7-a874-07f6cb1b904e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:51.731862 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5c1b136c-ef4f-45d7-a874-07f6cb1b904e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:51.732817 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5c1b136c-ef4f-45d7-a874-07f6cb1b904e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:51.733537 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5c1b136c-ef4f-45d7-a874-07f6cb1b904e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:51.734465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5c1b136c-ef4f-45d7-a874-07f6cb1b904e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:51.735131 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5c1b136c-ef4f-45d7-a874-07f6cb1b904e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:51.735772 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5c1b136c-ef4f-45d7-a874-07f6cb1b904e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:51.788396 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-904c9381-af5e-4ce1-b9e6-8eb72c2c1c4c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:51.789118 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-904c9381-af5e-4ce1-b9e6-8eb72c2c1c4c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:51.797963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-904c9381-af5e-4ce1-b9e6-8eb72c2c1c4c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:51.798456 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-904c9381-af5e-4ce1-b9e6-8eb72c2c1c4c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:51.801424 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-904c9381-af5e-4ce1-b9e6-8eb72c2c1c4c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:51.801424 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-904c9381-af5e-4ce1-b9e6-8eb72c2c1c4c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:51.801424 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-904c9381-af5e-4ce1-b9e6-8eb72c2c1c4c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:51.801424 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-904c9381-af5e-4ce1-b9e6-8eb72c2c1c4c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:52.044575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-5c1b136c-ef4f-45d7-a874-07f6cb1b904e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:52.051985 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-904c9381-af5e-4ce1-b9e6-8eb72c2c1c4c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:52.057053 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-5c1b136c-ef4f-45d7-a874-07f6cb1b904e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 200 len: 1366 microversion: 2.1 time: 0.338817 Aug 30 01:03:52.057792 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 194/377] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:51 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:52.070946 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-904c9381-af5e-4ce1-b9e6-8eb72c2c1c4c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1696 microversion: 2.1 time: 0.288639 Aug 30 01:03:52.073211 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 184/378] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:51 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1696 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:52.093115 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-ac62ee8e-b0e5-42c6-80e2-7e0483bb5cb8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:52.109715 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ac62ee8e-b0e5-42c6-80e2-7e0483bb5cb8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:52.110158 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ac62ee8e-b0e5-42c6-80e2-7e0483bb5cb8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:52.110601 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ac62ee8e-b0e5-42c6-80e2-7e0483bb5cb8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:52.137151 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-ac62ee8e-b0e5-42c6-80e2-7e0483bb5cb8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Going to try to start instance {{(pid=120630) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 01:03:52.197360 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-ac62ee8e-b0e5-42c6-80e2-7e0483bb5cb8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "POST /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2/action" status: 202 len: 0 microversion: 2.1 time: 0.108356 Aug 30 01:03:52.198243 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 195/379] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 30 01:03:52 2022] POST /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:03:52.213266 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-59d7e318-f5b5-4d40-a4ea-9f9f6d98d298 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:52.214014 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-59d7e318-f5b5-4d40-a4ea-9f9f6d98d298 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:52.224388 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-59d7e318-f5b5-4d40-a4ea-9f9f6d98d298 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:52.224904 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-59d7e318-f5b5-4d40-a4ea-9f9f6d98d298 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:52.225381 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-59d7e318-f5b5-4d40-a4ea-9f9f6d98d298 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:52.226099 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-59d7e318-f5b5-4d40-a4ea-9f9f6d98d298 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:52.226554 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-59d7e318-f5b5-4d40-a4ea-9f9f6d98d298 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:52.231583 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-59d7e318-f5b5-4d40-a4ea-9f9f6d98d298 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:52.300299 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-a4e2210f-088b-4225-92f5-7cf9b8947c2b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:52.301786 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-a4e2210f-088b-4225-92f5-7cf9b8947c2b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:52.313633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a4e2210f-088b-4225-92f5-7cf9b8947c2b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:52.315334 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a4e2210f-088b-4225-92f5-7cf9b8947c2b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:52.315791 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a4e2210f-088b-4225-92f5-7cf9b8947c2b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:52.317555 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a4e2210f-088b-4225-92f5-7cf9b8947c2b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:52.318027 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a4e2210f-088b-4225-92f5-7cf9b8947c2b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:52.318467 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a4e2210f-088b-4225-92f5-7cf9b8947c2b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:52.468022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-59d7e318-f5b5-4d40-a4ea-9f9f6d98d298 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:52.484804 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-59d7e318-f5b5-4d40-a4ea-9f9f6d98d298 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1705 microversion: 2.1 time: 0.273409 Aug 30 01:03:52.485504 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 185/380] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:52 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1705 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:52.490232 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-d82d4fbb-a7a4-4531-89b4-0ad6c999dc7e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:52.490843 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-d82d4fbb-a7a4-4531-89b4-0ad6c999dc7e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:52.500283 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d82d4fbb-a7a4-4531-89b4-0ad6c999dc7e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:52.500780 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d82d4fbb-a7a4-4531-89b4-0ad6c999dc7e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:52.501280 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d82d4fbb-a7a4-4531-89b4-0ad6c999dc7e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:52.507613 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d82d4fbb-a7a4-4531-89b4-0ad6c999dc7e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:52.508257 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d82d4fbb-a7a4-4531-89b4-0ad6c999dc7e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:52.508717 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d82d4fbb-a7a4-4531-89b4-0ad6c999dc7e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:52.520536 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-a4e2210f-088b-4225-92f5-7cf9b8947c2b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:52.534134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-a4e2210f-088b-4225-92f5-7cf9b8947c2b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1358 microversion: 2.1 time: 0.237921 Aug 30 01:03:52.535274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 196/381] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:52 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:52.681735 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-d82d4fbb-a7a4-4531-89b4-0ad6c999dc7e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:52.693895 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-d82d4fbb-a7a4-4531-89b4-0ad6c999dc7e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.207310 Aug 30 01:03:52.699766 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 186/382] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:52 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:53.094305 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-6980a2d3-c1f8-4d37-b7e6-cea4377b8519 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:53.095262 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-6980a2d3-c1f8-4d37-b7e6-cea4377b8519 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:53.121854 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6980a2d3-c1f8-4d37-b7e6-cea4377b8519 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:53.123640 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6980a2d3-c1f8-4d37-b7e6-cea4377b8519 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:53.124743 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6980a2d3-c1f8-4d37-b7e6-cea4377b8519 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:53.127843 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6980a2d3-c1f8-4d37-b7e6-cea4377b8519 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:53.129224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6980a2d3-c1f8-4d37-b7e6-cea4377b8519 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:53.129616 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6980a2d3-c1f8-4d37-b7e6-cea4377b8519 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:53.391158 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-6980a2d3-c1f8-4d37-b7e6-cea4377b8519 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:53.399617 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-6980a2d3-c1f8-4d37-b7e6-cea4377b8519 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 200 len: 1366 microversion: 2.1 time: 0.309168 Aug 30 01:03:53.405710 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 197/383] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:53 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:53.507646 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-621f3243-5d24-43a0-b37f-d258434dfa59 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:53.508327 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-621f3243-5d24-43a0-b37f-d258434dfa59 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:53.515118 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-621f3243-5d24-43a0-b37f-d258434dfa59 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:53.515541 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-621f3243-5d24-43a0-b37f-d258434dfa59 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:53.516045 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-621f3243-5d24-43a0-b37f-d258434dfa59 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:53.517016 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-621f3243-5d24-43a0-b37f-d258434dfa59 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:53.517370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-621f3243-5d24-43a0-b37f-d258434dfa59 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:53.517791 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-621f3243-5d24-43a0-b37f-d258434dfa59 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:53.558290 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-9e62b888-d700-4871-95ff-ab8bb1a00bdf tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:53.559566 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-9e62b888-d700-4871-95ff-ab8bb1a00bdf tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:53.566021 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9e62b888-d700-4871-95ff-ab8bb1a00bdf tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:53.566515 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9e62b888-d700-4871-95ff-ab8bb1a00bdf tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:53.566952 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9e62b888-d700-4871-95ff-ab8bb1a00bdf tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:53.567648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9e62b888-d700-4871-95ff-ab8bb1a00bdf tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:53.568357 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9e62b888-d700-4871-95ff-ab8bb1a00bdf tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:53.569269 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9e62b888-d700-4871-95ff-ab8bb1a00bdf tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:53.590699 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:53.762660 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-621f3243-5d24-43a0-b37f-d258434dfa59 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:53.775506 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-621f3243-5d24-43a0-b37f-d258434dfa59 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1705 microversion: 2.1 time: 0.271816 Aug 30 01:03:53.790989 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 187/384] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:53 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1705 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:53.794694 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-34f045e1-cb96-4dc4-818b-e093b624ce55 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:53.796019 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-34f045e1-cb96-4dc4-818b-e093b624ce55 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:53.803027 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-34f045e1-cb96-4dc4-818b-e093b624ce55 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:53.803629 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-34f045e1-cb96-4dc4-818b-e093b624ce55 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:53.804253 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-34f045e1-cb96-4dc4-818b-e093b624ce55 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:53.805377 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-34f045e1-cb96-4dc4-818b-e093b624ce55 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:53.807886 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-34f045e1-cb96-4dc4-818b-e093b624ce55 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:53.808783 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-34f045e1-cb96-4dc4-818b-e093b624ce55 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:53.966762 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-9e62b888-d700-4871-95ff-ab8bb1a00bdf tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:53.979856 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-9e62b888-d700-4871-95ff-ab8bb1a00bdf tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1358 microversion: 2.1 time: 0.427434 Aug 30 01:03:53.981118 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 198/385] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:53 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1358 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:54.015995 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-34f045e1-cb96-4dc4-818b-e093b624ce55 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:54.023867 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-34f045e1-cb96-4dc4-818b-e093b624ce55 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1502 microversion: 2.1 time: 0.236650 Aug 30 01:03:54.024432 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 188/386] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:53 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1502 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:54.044745 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-e5817b13-d3b0-4fa4-81f0-3bc2ef08f28f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4cc923a-5d4b-44a2-ba78-c5badb992048"}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:54.047197 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-e5817b13-d3b0-4fa4-81f0-3bc2ef08f28f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:54.053599 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e5817b13-d3b0-4fa4-81f0-3bc2ef08f28f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:54.054099 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e5817b13-d3b0-4fa4-81f0-3bc2ef08f28f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:54.054545 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e5817b13-d3b0-4fa4-81f0-3bc2ef08f28f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:54.055253 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e5817b13-d3b0-4fa4-81f0-3bc2ef08f28f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:54.055707 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e5817b13-d3b0-4fa4-81f0-3bc2ef08f28f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:54.056136 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e5817b13-d3b0-4fa4-81f0-3bc2ef08f28f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:54.110844 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-e5817b13-d3b0-4fa4-81f0-3bc2ef08f28f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] HTTP exception thrown: Cannot 'attach_volume' instance 12338ddc-349d-4f0b-b6d8-4bb83f19e320 while it is in vm_state rescued Aug 30 01:03:54.113302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-e5817b13-d3b0-4fa4-81f0-3bc2ef08f28f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Request method failure captured: Aug 30 01:03:54.113302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: POST /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320/os-volume_attachments HTTP/1.1 Aug 30 01:03:54.113302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:03:54.113302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:03:54.113302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:03:54.113302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 74 Aug 30 01:03:54.113302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:03:54.113302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:03:54.113302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:03:54.113302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:03:54.113302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWFZl1eXeWdEDlle0hI0paFtZlD2PL7IqHhMTCZh9t4-qj1yZKZ-oMZd8isPpWOq6EPoKdYey1DgasN-d057FigVzeaBK7xvIgMM59Rae3evOwrcybdKfuqMiKZ3wBQJQbTCDy7Hwhm_wrs2y5ZbRIUIowk7aEYT1BJ8gns6uC2nhJw Aug 30 01:03:54.113302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:03:54.113302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:03:54.113302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:03:54.113302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:03:54.113302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:03:54.113302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:03:54.113302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: ceebbaa5dd9d4110a6393190c5b466f0 Aug 30 01:03:54.113302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-436411527 Aug 30 01:03:54.113302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:03:54.113302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:03:54.114913 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ceebbaa5dd9d4110a6393190c5b466f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ceebbaa5dd9d4110a6393190c5b466f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ceebbaa5dd9d4110a6393190c5b466f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ceebbaa5dd9d4110a6393190c5b466f0"}]}] Aug 30 01:03:54.114913 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-ServerRescueNegativeTestJSON-436411527 Aug 30 01:03:54.114913 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: ceebbaa5dd9d4110a6393190c5b466f0 Aug 30 01:03:54.114913 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-436411527 Aug 30 01:03:54.114913 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-ServerRescueNegativeTestJSON-436411527-project Aug 30 01:03:54.114913 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:03:54.114913 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:03:54.114913 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: 5c95c8ce27fd43c6a6fe10443b6bde13 Aug 30 01:03:54.114913 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-ServerRescueNegativeTestJSON-436411527-project Aug 30 01:03:54.114913 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Aug 30 01:03:54.114913 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {"volumeAttachment": {"volumeId": "c4cc923a-5d4b-44a2-ba78-c5badb992048"}} Aug 30 01:03:54.114913 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:03:54.115830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Cannot 'attach_volume' instance 12338ddc-349d-4f0b-b6d8-4bb83f19e320 while it is in vm_state rescued Aug 30 01:03:54.115830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'server_id': '12338ddc-349d-4f0b-b6d8-4bb83f19e320', 'body': {'volumeAttachment': {'volumeId': 'c4cc923a-5d4b-44a2-ba78-c5badb992048'}}} Aug 30 01:03:54.115830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:03:54.115830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:03:54.115830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 01:03:54.115830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 01:03:54.115830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 01:03:54.115830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 01:03:54.115830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 01:03:54.115830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 01:03:54.115830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 12338ddc-349d-4f0b-b6d8-4bb83f19e320 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 30 01:03:54.115830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:03:54.115830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:03:54.115830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:03:54.115830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:03:54.115830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:03:54.115830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:03:54.115830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:03:54.115830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:03:54.117006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:03:54.117006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:03:54.117006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:03:54.117006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:03:54.117006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:03:54.117006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:03:54.117006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:03:54.117006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:03:54.117006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 30 01:03:54.117006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 01:03:54.117006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 01:03:54.117006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 01:03:54.117006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 12338ddc-349d-4f0b-b6d8-4bb83f19e320 while it is in vm_state rescued Aug 30 01:03:54.117006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:03:54.117006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:03:54.117006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:03:54.117006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:03:54.117006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:03:54.117006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:03:54.118116 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:03:54.118116 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:03:54.118116 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 12338ddc-349d-4f0b-b6d8-4bb83f19e320 while it is in vm_state rescued Aug 30 01:03:54.118116 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:03:54.120051 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-e5817b13-d3b0-4fa4-81f0-3bc2ef08f28f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Returning 409 to user: Cannot 'attach_volume' instance 12338ddc-349d-4f0b-b6d8-4bb83f19e320 while it is in vm_state rescued {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:03:54.121070 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-e5817b13-d3b0-4fa4-81f0-3bc2ef08f28f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "POST /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.080748 Aug 30 01:03:54.123088 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 199/387] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 30 01:03:54 2022] POST /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320/os-volume_attachments => generated 152 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 01:03:54.135719 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-694477ef-1637-41be-9256-99faa4a59c26 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:54.136670 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-694477ef-1637-41be-9256-99faa4a59c26 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:54.146029 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-694477ef-1637-41be-9256-99faa4a59c26 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:54.146523 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-694477ef-1637-41be-9256-99faa4a59c26 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:54.146958 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-694477ef-1637-41be-9256-99faa4a59c26 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:54.147742 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-694477ef-1637-41be-9256-99faa4a59c26 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:54.148246 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-694477ef-1637-41be-9256-99faa4a59c26 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:54.148801 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-694477ef-1637-41be-9256-99faa4a59c26 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:54.298804 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-694477ef-1637-41be-9256-99faa4a59c26 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "POST /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320/action" status: 202 len: 0 microversion: 2.1 time: 0.169905 Aug 30 01:03:54.299532 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 189/388] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 30 01:03:54 2022] POST /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:03:54.310677 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-cb1d6f48-31c0-47ad-ad02-02739c46dd43 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:54.311585 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-cb1d6f48-31c0-47ad-ad02-02739c46dd43 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:54.320960 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cb1d6f48-31c0-47ad-ad02-02739c46dd43 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:54.321662 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cb1d6f48-31c0-47ad-ad02-02739c46dd43 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:54.323235 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cb1d6f48-31c0-47ad-ad02-02739c46dd43 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:54.324438 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cb1d6f48-31c0-47ad-ad02-02739c46dd43 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:54.325256 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cb1d6f48-31c0-47ad-ad02-02739c46dd43 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:54.325850 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cb1d6f48-31c0-47ad-ad02-02739c46dd43 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:54.423762 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-5a3b8cab-f123-4fee-8cc4-d5941d63acd2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:54.424459 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-5a3b8cab-f123-4fee-8cc4-d5941d63acd2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:54.431175 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5a3b8cab-f123-4fee-8cc4-d5941d63acd2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:54.432000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5a3b8cab-f123-4fee-8cc4-d5941d63acd2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:54.434017 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5a3b8cab-f123-4fee-8cc4-d5941d63acd2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:54.434992 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5a3b8cab-f123-4fee-8cc4-d5941d63acd2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:54.435763 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5a3b8cab-f123-4fee-8cc4-d5941d63acd2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:54.436408 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5a3b8cab-f123-4fee-8cc4-d5941d63acd2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:54.611039 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-cb1d6f48-31c0-47ad-ad02-02739c46dd43 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:54.620309 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-cb1d6f48-31c0-47ad-ad02-02739c46dd43 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1510 microversion: 2.1 time: 0.315516 Aug 30 01:03:54.625479 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 200/389] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:54 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1510 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:54.800036 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-de5f145e-896c-4a7f-974c-37d5353ccd09 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:54.800612 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-de5f145e-896c-4a7f-974c-37d5353ccd09 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:54.807865 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-de5f145e-896c-4a7f-974c-37d5353ccd09 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:54.808680 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-de5f145e-896c-4a7f-974c-37d5353ccd09 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:54.809216 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-de5f145e-896c-4a7f-974c-37d5353ccd09 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:54.810014 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-de5f145e-896c-4a7f-974c-37d5353ccd09 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:54.810691 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-de5f145e-896c-4a7f-974c-37d5353ccd09 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:54.811134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-de5f145e-896c-4a7f-974c-37d5353ccd09 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:54.958544 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-5a3b8cab-f123-4fee-8cc4-d5941d63acd2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:54.967207 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-5a3b8cab-f123-4fee-8cc4-d5941d63acd2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 200 len: 1555 microversion: 2.1 time: 0.547577 Aug 30 01:03:54.971226 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 190/390] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:54 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 1555 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:54.990498 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e57e5406-3536-40ab-b037-b2b772e456ed tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:54.990994 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e57e5406-3536-40ab-b037-b2b772e456ed tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:54.998096 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e57e5406-3536-40ab-b037-b2b772e456ed tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:54.998591 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e57e5406-3536-40ab-b037-b2b772e456ed tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:54.999207 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e57e5406-3536-40ab-b037-b2b772e456ed tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:54.999934 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e57e5406-3536-40ab-b037-b2b772e456ed tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:55.000391 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e57e5406-3536-40ab-b037-b2b772e456ed tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:55.000973 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e57e5406-3536-40ab-b037-b2b772e456ed tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:55.108919 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-de5f145e-896c-4a7f-974c-37d5353ccd09 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:55.118350 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-de5f145e-896c-4a7f-974c-37d5353ccd09 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1705 microversion: 2.1 time: 0.322456 Aug 30 01:03:55.119021 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 201/391] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:54 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1705 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:55.125010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-69ad2828-c6d5-4b7e-b02e-22766587543f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:55.125650 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-69ad2828-c6d5-4b7e-b02e-22766587543f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:55.132388 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-69ad2828-c6d5-4b7e-b02e-22766587543f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:55.133149 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-69ad2828-c6d5-4b7e-b02e-22766587543f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:55.133812 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-69ad2828-c6d5-4b7e-b02e-22766587543f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:55.134637 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-69ad2828-c6d5-4b7e-b02e-22766587543f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:55.135234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-69ad2828-c6d5-4b7e-b02e-22766587543f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:55.135884 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-69ad2828-c6d5-4b7e-b02e-22766587543f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:55.143371 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e57e5406-3536-40ab-b037-b2b772e456ed tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156726 Aug 30 01:03:55.144758 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 191/392] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 30 01:03:54 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:03:55.571853 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-69ad2828-c6d5-4b7e-b02e-22766587543f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:55.601960 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-69ad2828-c6d5-4b7e-b02e-22766587543f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1358 microversion: 2.1 time: 0.478380 Aug 30 01:03:55.609488 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 202/393] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:55 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1358 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:55.641453 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-8f6ea470-d6b1-44cf-87f9-b0f119e74f59 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:55.642683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-8f6ea470-d6b1-44cf-87f9-b0f119e74f59 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:55.653978 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f6ea470-d6b1-44cf-87f9-b0f119e74f59 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:55.654739 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f6ea470-d6b1-44cf-87f9-b0f119e74f59 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:55.655409 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f6ea470-d6b1-44cf-87f9-b0f119e74f59 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:55.656360 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f6ea470-d6b1-44cf-87f9-b0f119e74f59 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:55.657055 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f6ea470-d6b1-44cf-87f9-b0f119e74f59 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:55.657730 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f6ea470-d6b1-44cf-87f9-b0f119e74f59 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:56.112030 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-8f6ea470-d6b1-44cf-87f9-b0f119e74f59 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:56.128896 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-8f6ea470-d6b1-44cf-87f9-b0f119e74f59 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1510 microversion: 2.1 time: 0.486812 Aug 30 01:03:56.133727 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 192/394] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:55 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1510 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:56.143997 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8c0c22e3-8a45-48da-ac0f-c3a38ff53395 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:56.144619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8c0c22e3-8a45-48da-ac0f-c3a38ff53395 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:56.158398 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8c0c22e3-8a45-48da-ac0f-c3a38ff53395 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:56.161500 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8c0c22e3-8a45-48da-ac0f-c3a38ff53395 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:56.161973 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8c0c22e3-8a45-48da-ac0f-c3a38ff53395 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:56.162719 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8c0c22e3-8a45-48da-ac0f-c3a38ff53395 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:56.163204 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8c0c22e3-8a45-48da-ac0f-c3a38ff53395 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:56.163624 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8c0c22e3-8a45-48da-ac0f-c3a38ff53395 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:56.431280 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8c0c22e3-8a45-48da-ac0f-c3a38ff53395 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:56.446221 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8c0c22e3-8a45-48da-ac0f-c3a38ff53395 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1705 microversion: 2.1 time: 0.307820 Aug 30 01:03:56.462328 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 203/395] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:56 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1705 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:56.640188 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-a156bd1a-9bb9-4d4c-9be8-ef1bf458523e tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:56.640900 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-a156bd1a-9bb9-4d4c-9be8-ef1bf458523e tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:56.648391 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a156bd1a-9bb9-4d4c-9be8-ef1bf458523e tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:56.649228 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a156bd1a-9bb9-4d4c-9be8-ef1bf458523e tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:56.650038 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a156bd1a-9bb9-4d4c-9be8-ef1bf458523e tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:56.651512 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a156bd1a-9bb9-4d4c-9be8-ef1bf458523e tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:56.656129 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a156bd1a-9bb9-4d4c-9be8-ef1bf458523e tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:56.657064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a156bd1a-9bb9-4d4c-9be8-ef1bf458523e tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:56.842528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-a156bd1a-9bb9-4d4c-9be8-ef1bf458523e tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:56.857364 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-a156bd1a-9bb9-4d4c-9be8-ef1bf458523e tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1358 microversion: 2.1 time: 0.233212 Aug 30 01:03:56.858656 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 193/396] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:56 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:57.155332 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-c56783d7-16e9-4b70-8b48-d200f48b04bb tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:57.156041 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-c56783d7-16e9-4b70-8b48-d200f48b04bb tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:57.164313 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c56783d7-16e9-4b70-8b48-d200f48b04bb tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:57.164985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c56783d7-16e9-4b70-8b48-d200f48b04bb tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:57.165588 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c56783d7-16e9-4b70-8b48-d200f48b04bb tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:57.166832 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c56783d7-16e9-4b70-8b48-d200f48b04bb tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:57.167435 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c56783d7-16e9-4b70-8b48-d200f48b04bb tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:57.168013 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c56783d7-16e9-4b70-8b48-d200f48b04bb tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:57.367730 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-c56783d7-16e9-4b70-8b48-d200f48b04bb tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:57.381992 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-c56783d7-16e9-4b70-8b48-d200f48b04bb tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1510 microversion: 2.1 time: 0.231297 Aug 30 01:03:57.383196 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 204/397] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:57 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1510 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:57.475495 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-fcc75c5a-b5f5-4c12-ae7a-2b4a67a4f4c0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:57.476066 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-fcc75c5a-b5f5-4c12-ae7a-2b4a67a4f4c0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:57.489746 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fcc75c5a-b5f5-4c12-ae7a-2b4a67a4f4c0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:57.491291 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fcc75c5a-b5f5-4c12-ae7a-2b4a67a4f4c0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:57.491940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fcc75c5a-b5f5-4c12-ae7a-2b4a67a4f4c0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:57.493037 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fcc75c5a-b5f5-4c12-ae7a-2b4a67a4f4c0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:57.493928 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fcc75c5a-b5f5-4c12-ae7a-2b4a67a4f4c0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:57.495586 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fcc75c5a-b5f5-4c12-ae7a-2b4a67a4f4c0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:57.693054 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-fcc75c5a-b5f5-4c12-ae7a-2b4a67a4f4c0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:57.703776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-fcc75c5a-b5f5-4c12-ae7a-2b4a67a4f4c0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1709 microversion: 2.1 time: 0.238728 Aug 30 01:03:57.704533 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 194/398] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:57 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1709 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:57.879474 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-b9eaa4de-b2c3-4bcc-900e-85484b6ebfc6 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:57.880638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-b9eaa4de-b2c3-4bcc-900e-85484b6ebfc6 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:57.888209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b9eaa4de-b2c3-4bcc-900e-85484b6ebfc6 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:57.889204 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b9eaa4de-b2c3-4bcc-900e-85484b6ebfc6 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:57.890164 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b9eaa4de-b2c3-4bcc-900e-85484b6ebfc6 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:57.891226 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b9eaa4de-b2c3-4bcc-900e-85484b6ebfc6 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:57.891943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b9eaa4de-b2c3-4bcc-900e-85484b6ebfc6 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:57.892584 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b9eaa4de-b2c3-4bcc-900e-85484b6ebfc6 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:57.995279 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-14058a88-ab18-4772-8029-238facaca90f req-c858ec44-9bf9-49d5-908f-72c8a5eb48c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f9ce423-87fe-4742-ab18-537e725fb3c2", "tag": "f0e1db00-4448-4f4f-865f-c2f369d94a25"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:58.013436 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-14058a88-ab18-4772-8029-238facaca90f req-c858ec44-9bf9-49d5-908f-72c8a5eb48c1 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:58.015321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-14058a88-ab18-4772-8029-238facaca90f req-c858ec44-9bf9-49d5-908f-72c8a5eb48c1 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:58.016331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-14058a88-ab18-4772-8029-238facaca90f req-c858ec44-9bf9-49d5-908f-72c8a5eb48c1 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:58.050447 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-14058a88-ab18-4772-8029-238facaca90f req-c858ec44-9bf9-49d5-908f-72c8a5eb48c1 service nova] Creating event network-changed:f0e1db00-4448-4f4f-865f-c2f369d94a25 for instance 0f9ce423-87fe-4742-ab18-537e725fb3c2 on hv-cinder-81514 Aug 30 01:03:58.060588 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-14058a88-ab18-4772-8029-238facaca90f req-c858ec44-9bf9-49d5-908f-72c8a5eb48c1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069468 Aug 30 01:03:58.063093 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 195/399] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:58.113290 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-b9eaa4de-b2c3-4bcc-900e-85484b6ebfc6 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:58.127580 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-b9eaa4de-b2c3-4bcc-900e-85484b6ebfc6 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1358 microversion: 2.1 time: 0.252048 Aug 30 01:03:58.128182 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 205/400] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:57 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:58.405251 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-f353880b-8a10-40f9-b860-23c3108f184d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:58.406065 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-f353880b-8a10-40f9-b860-23c3108f184d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:58.412831 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f353880b-8a10-40f9-b860-23c3108f184d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:58.414051 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f353880b-8a10-40f9-b860-23c3108f184d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:58.414554 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f353880b-8a10-40f9-b860-23c3108f184d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:58.415378 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f353880b-8a10-40f9-b860-23c3108f184d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:58.416240 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f353880b-8a10-40f9-b860-23c3108f184d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:58.417759 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f353880b-8a10-40f9-b860-23c3108f184d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:58.572712 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-f353880b-8a10-40f9-b860-23c3108f184d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:58.580386 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-f353880b-8a10-40f9-b860-23c3108f184d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1510 microversion: 2.1 time: 0.181751 Aug 30 01:03:58.580955 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 196/401] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:58 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:59.151564 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-3fd4be44-913d-4b5c-9b1f-59cba61eacbc tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:59.153921 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-3fd4be44-913d-4b5c-9b1f-59cba61eacbc tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:59.162975 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3fd4be44-913d-4b5c-9b1f-59cba61eacbc tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:59.163821 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3fd4be44-913d-4b5c-9b1f-59cba61eacbc tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:59.164500 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3fd4be44-913d-4b5c-9b1f-59cba61eacbc tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:59.165473 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3fd4be44-913d-4b5c-9b1f-59cba61eacbc tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:59.167045 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3fd4be44-913d-4b5c-9b1f-59cba61eacbc tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:59.167700 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3fd4be44-913d-4b5c-9b1f-59cba61eacbc tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:59.431020 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-3fd4be44-913d-4b5c-9b1f-59cba61eacbc tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:59.450263 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-3fd4be44-913d-4b5c-9b1f-59cba61eacbc tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1358 microversion: 2.1 time: 0.304567 Aug 30 01:03:59.451179 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 206/402] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:59 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1358 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:59.587988 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-6633bf63-7630-4b12-aee1-a9e0e719eaa9 req-2d564a82-24ba-4a84-8944-845c9ac93825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5598be2a-00db-4303-bc81-a7fb3674e371", "name": "network-vif-plugged", "status": "completed", "tag": "e2481fa1-2595-4100-98cf-07e796517813"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:59.602556 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-70c18dcc-94d9-4b25-968a-050ab91463e0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:59.604335 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-70c18dcc-94d9-4b25-968a-050ab91463e0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:59.622546 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-70c18dcc-94d9-4b25-968a-050ab91463e0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:59.625364 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-70c18dcc-94d9-4b25-968a-050ab91463e0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:59.626479 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-70c18dcc-94d9-4b25-968a-050ab91463e0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:59.627895 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-6633bf63-7630-4b12-aee1-a9e0e719eaa9 req-2d564a82-24ba-4a84-8944-845c9ac93825 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:59.629284 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-6633bf63-7630-4b12-aee1-a9e0e719eaa9 req-2d564a82-24ba-4a84-8944-845c9ac93825 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:59.631909 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-6633bf63-7630-4b12-aee1-a9e0e719eaa9 req-2d564a82-24ba-4a84-8944-845c9ac93825 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:59.632275 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-70c18dcc-94d9-4b25-968a-050ab91463e0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:59.632986 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-70c18dcc-94d9-4b25-968a-050ab91463e0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:59.637017 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-70c18dcc-94d9-4b25-968a-050ab91463e0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:59.677204 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-6633bf63-7630-4b12-aee1-a9e0e719eaa9 req-2d564a82-24ba-4a84-8944-845c9ac93825 service nova] Creating event network-vif-plugged:e2481fa1-2595-4100-98cf-07e796517813 for instance 5598be2a-00db-4303-bc81-a7fb3674e371 on hv-cinder-81514 Aug 30 01:03:59.696564 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-6633bf63-7630-4b12-aee1-a9e0e719eaa9 req-2d564a82-24ba-4a84-8944-845c9ac93825 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112843 Aug 30 01:03:59.699107 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 197/403] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:00.006140 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-70c18dcc-94d9-4b25-968a-050ab91463e0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:00.015375 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-70c18dcc-94d9-4b25-968a-050ab91463e0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1510 microversion: 2.1 time: 0.416550 Aug 30 01:04:00.016739 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 207/404] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:59 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1510 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:04:00.474236 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-d25a4ebe-ff6e-4583-ae07-c5d534f08638 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:00.474950 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-d25a4ebe-ff6e-4583-ae07-c5d534f08638 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:00.488128 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d25a4ebe-ff6e-4583-ae07-c5d534f08638 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:00.491593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d25a4ebe-ff6e-4583-ae07-c5d534f08638 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:00.491818 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d25a4ebe-ff6e-4583-ae07-c5d534f08638 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:00.492564 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d25a4ebe-ff6e-4583-ae07-c5d534f08638 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:00.493029 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d25a4ebe-ff6e-4583-ae07-c5d534f08638 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:00.501851 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d25a4ebe-ff6e-4583-ae07-c5d534f08638 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:00.744732 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-d25a4ebe-ff6e-4583-ae07-c5d534f08638 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:00.759216 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-d25a4ebe-ff6e-4583-ae07-c5d534f08638 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1358 microversion: 2.1 time: 0.290463 Aug 30 01:04:00.760298 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 198/405] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:00 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1358 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:01.038074 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-1d73d5f6-47c1-4249-b726-0c7e56c58c4a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:01.041626 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-1d73d5f6-47c1-4249-b726-0c7e56c58c4a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:01.053283 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1d73d5f6-47c1-4249-b726-0c7e56c58c4a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:01.054174 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1d73d5f6-47c1-4249-b726-0c7e56c58c4a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:01.054726 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1d73d5f6-47c1-4249-b726-0c7e56c58c4a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:01.056279 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1d73d5f6-47c1-4249-b726-0c7e56c58c4a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:01.057672 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1d73d5f6-47c1-4249-b726-0c7e56c58c4a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:01.058517 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1d73d5f6-47c1-4249-b726-0c7e56c58c4a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:01.506286 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-1d73d5f6-47c1-4249-b726-0c7e56c58c4a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:01.514405 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-1d73d5f6-47c1-4249-b726-0c7e56c58c4a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1516 microversion: 2.1 time: 0.480432 Aug 30 01:04:01.514969 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 208/406] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:01 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1516 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:01.780893 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-02aaf04b-6d9e-41a5-985e-18ad63ce69df tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:01.781557 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-02aaf04b-6d9e-41a5-985e-18ad63ce69df tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:01.793397 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-02aaf04b-6d9e-41a5-985e-18ad63ce69df tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:01.793977 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-02aaf04b-6d9e-41a5-985e-18ad63ce69df tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:01.795123 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-02aaf04b-6d9e-41a5-985e-18ad63ce69df tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:01.796777 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-02aaf04b-6d9e-41a5-985e-18ad63ce69df tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:01.797834 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-02aaf04b-6d9e-41a5-985e-18ad63ce69df tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:01.798581 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-02aaf04b-6d9e-41a5-985e-18ad63ce69df tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:01.827570 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-7e30ba17-1e69-4971-9533-c615f43b0b7f tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Action: 'create', calling method: .version_select at 0x7f0f528591f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1418735735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrHlISaajDhTNxDJasKcROycXcv+gLo86xmOz+Vbx5Ru6ySo8wV2u1mY8fXUTHfjpMcfGYqJvLf7ge1MzQLQB2DgPlWUOli7CEqmuYFBHS4vjag/F5eBaDizviLGxZacg=="}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:01.836101 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-7e30ba17-1e69-4971-9533-c615f43b0b7f tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Getting quotas for project a6380baa172744fa9d7ba5b81f847906. Resources: {'key_pairs'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:04:01.840121 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:01.841770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-7e30ba17-1e69-4971-9533-c615f43b0b7f tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Getting quotas for user d467895d586a43719d2abdf4105187f8 and project a6380baa172744fa9d7ba5b81f847906. Resources: {'key_pairs'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:04:01.875305 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-7e30ba17-1e69-4971-9533-c615f43b0b7f tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.259581 Aug 30 01:04:01.876266 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 199/407] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 30 01:04:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:01.971394 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-02aaf04b-6d9e-41a5-985e-18ad63ce69df tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:01.980014 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-02aaf04b-6d9e-41a5-985e-18ad63ce69df tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1548 microversion: 2.1 time: 0.203315 Aug 30 01:04:01.980782 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 209/408] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:01 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1548 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:04:02.000965 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-1f9b2fc6-1ea7-4613-9d38-b22d5ef010cd tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:02.001618 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-1f9b2fc6-1ea7-4613-9d38-b22d5ef010cd tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:02.009707 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f9b2fc6-1ea7-4613-9d38-b22d5ef010cd tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:02.009707 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f9b2fc6-1ea7-4613-9d38-b22d5ef010cd tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:02.010173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f9b2fc6-1ea7-4613-9d38-b22d5ef010cd tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:02.010955 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f9b2fc6-1ea7-4613-9d38-b22d5ef010cd tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:02.011504 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f9b2fc6-1ea7-4613-9d38-b22d5ef010cd tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:02.012300 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f9b2fc6-1ea7-4613-9d38-b22d5ef010cd tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:02.197496 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-1f9b2fc6-1ea7-4613-9d38-b22d5ef010cd tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:02.203074 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:02.210198 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-1f9b2fc6-1ea7-4613-9d38-b22d5ef010cd tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1548 microversion: 2.1 time: 0.213029 Aug 30 01:04:02.211156 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 200/409] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:01 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1548 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:04:02.235928 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-97d4bdcd-5f79-4fa0-93f6-cb4b024af85f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:02.250165 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-97d4bdcd-5f79-4fa0-93f6-cb4b024af85f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:02.250955 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-97d4bdcd-5f79-4fa0-93f6-cb4b024af85f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Searching by: {'deleted': False, 'project_id': 'fca43fd867154911badb413c7046befd'} {{(pid=120630) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 01:04:02.265539 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-97d4bdcd-5f79-4fa0-93f6-cb4b024af85f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:02.266214 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-97d4bdcd-5f79-4fa0-93f6-cb4b024af85f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:02.266654 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-97d4bdcd-5f79-4fa0-93f6-cb4b024af85f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:02.267415 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-97d4bdcd-5f79-4fa0-93f6-cb4b024af85f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:02.267916 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-97d4bdcd-5f79-4fa0-93f6-cb4b024af85f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:02.268364 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-97d4bdcd-5f79-4fa0-93f6-cb4b024af85f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:02.369619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.multi_cell_list [None req-97d4bdcd-5f79-4fa0-93f6-cb4b024af85f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120630) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 01:04:02.481248 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-97d4bdcd-5f79-4fa0-93f6-cb4b024af85f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.250468 Aug 30 01:04:02.481878 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 210/410] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Aug 30 01:04:02 2022] GET /compute/v2.1/servers => generated 343 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:02.493577 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-6743a2cf-484e-42c5-8838-3979e2a6b071 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:02.494835 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-6743a2cf-484e-42c5-8838-3979e2a6b071 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:02.502202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6743a2cf-484e-42c5-8838-3979e2a6b071 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:02.502660 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6743a2cf-484e-42c5-8838-3979e2a6b071 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:02.503371 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6743a2cf-484e-42c5-8838-3979e2a6b071 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:02.504357 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6743a2cf-484e-42c5-8838-3979e2a6b071 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:02.504816 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6743a2cf-484e-42c5-8838-3979e2a6b071 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:02.505441 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6743a2cf-484e-42c5-8838-3979e2a6b071 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:02.658571 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6743a2cf-484e-42c5-8838-3979e2a6b071 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:02.669230 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-6743a2cf-484e-42c5-8838-3979e2a6b071 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1548 microversion: 2.1 time: 0.179711 Aug 30 01:04:02.670632 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 201/411] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:02 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1548 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:04:02.897492 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-feb32bff-6a94-4798-8916-9c1cc29012cd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Action: 'create', calling method: .version_select at 0x7f0f52840160>, body: {"keypair": {"name": "tempest-keypair-366021714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2GiwkRCF4OVsXX/PE4nD/Oh7/Nrvnp8rkT6mCXmo7WYjg4JKNr/aVPD4l9BZqeYD3+dA/7h+6f0rdemoKYtxswHpeO2igHA2HopGF6kL6WiVSlk3bYw1RaHswQblaOlw=="}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:02.914702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-feb32bff-6a94-4798-8916-9c1cc29012cd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Getting quotas for project ceebbaa5dd9d4110a6393190c5b466f0. Resources: {'key_pairs'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:04:02.919848 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-feb32bff-6a94-4798-8916-9c1cc29012cd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Getting quotas for user 5c95c8ce27fd43c6a6fe10443b6bde13 and project ceebbaa5dd9d4110a6393190c5b466f0. Resources: {'key_pairs'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:04:02.944794 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-feb32bff-6a94-4798-8916-9c1cc29012cd tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053928 Aug 30 01:04:02.945497 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 211/412] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 30 01:04:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:04.383371 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-b45a374c-2b47-436a-b2cd-8ce4e6aac74f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-160012215", "imageRef": "d6c817b5-c41c-4210-a963-172386e2e582", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ee6ec53-bf26-4fab-b55f-62bd4221ec41"}], "security_groups": [{"name": "tempest-securitygroup--1420928236"}], "key_name": "tempest-keypair-366021714", "user_data": "}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:04.440524 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-335bf128-0c03-4d02-a842-f8f345477a74 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5d52ff1-2b30-4129-88db-4c1c9eb24be7"}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:04.443500 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-335bf128-0c03-4d02-a842-f8f345477a74 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:04.455103 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-335bf128-0c03-4d02-a842-f8f345477a74 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:04.455882 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-335bf128-0c03-4d02-a842-f8f345477a74 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:04.456453 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-335bf128-0c03-4d02-a842-f8f345477a74 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:04.457524 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-335bf128-0c03-4d02-a842-f8f345477a74 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:04.458172 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-335bf128-0c03-4d02-a842-f8f345477a74 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:04.458774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-335bf128-0c03-4d02-a842-f8f345477a74 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:04.531707 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.network.neutron [None req-b45a374c-2b47-436a-b2cd-8ce4e6aac74f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] validate_networks() for [('5ee6ec53-bf26-4fab-b55f-62bd4221ec41', None, None, None, None, None)] {{(pid=120631) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:04:04.814315 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-335bf128-0c03-4d02-a842-f8f345477a74 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "POST /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378063 Aug 30 01:04:04.814936 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 212/413] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 30 01:04:04 2022] POST /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371/os-volume_attachments => generated 194 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:04:04.996192 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-b45a374c-2b47-436a-b2cd-8ce4e6aac74f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Flavor limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:04:04.996585 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-b45a374c-2b47-436a-b2cd-8ce4e6aac74f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Image limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:04:04.997060 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-b45a374c-2b47-436a-b2cd-8ce4e6aac74f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Flavor pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:04:04.997498 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-b45a374c-2b47-436a-b2cd-8ce4e6aac74f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Image pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:04:04.997907 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-b45a374c-2b47-436a-b2cd-8ce4e6aac74f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:04:05.011395 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b45a374c-2b47-436a-b2cd-8ce4e6aac74f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:05.011914 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b45a374c-2b47-436a-b2cd-8ce4e6aac74f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:05.012358 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b45a374c-2b47-436a-b2cd-8ce4e6aac74f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:05.013112 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b45a374c-2b47-436a-b2cd-8ce4e6aac74f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:05.013574 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b45a374c-2b47-436a-b2cd-8ce4e6aac74f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:05.013999 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b45a374c-2b47-436a-b2cd-8ce4e6aac74f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:05.033587 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-b45a374c-2b47-436a-b2cd-8ce4e6aac74f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Getting quotas for project ceebbaa5dd9d4110a6393190c5b466f0. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:04:05.037948 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-b45a374c-2b47-436a-b2cd-8ce4e6aac74f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Getting quotas for user 5c95c8ce27fd43c6a6fe10443b6bde13 and project ceebbaa5dd9d4110a6393190c5b466f0. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:04:05.050464 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-b45a374c-2b47-436a-b2cd-8ce4e6aac74f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Going to run 1 instances... {{(pid=120631) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:04:05.053257 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-b45a374c-2b47-436a-b2cd-8ce4e6aac74f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6c817b5-c41c-4210-a963-172386e2e582',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120631) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:04:05.105655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-b45a374c-2b47-436a-b2cd-8ce4e6aac74f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.727417 Aug 30 01:04:05.109898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 202/414] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 30 01:04:04 2022] POST /compute/v2.1/servers => generated 409 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:04:05.119513 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-ccfed683-f452-40cf-a089-0d1cc0251434 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:05.120066 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-ccfed683-f452-40cf-a089-0d1cc0251434 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:05.195817 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-ccfed683-f452-40cf-a089-0d1cc0251434 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:05.212975 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-ccfed683-f452-40cf-a089-0d1cc0251434 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1244 microversion: 2.1 time: 0.099281 Aug 30 01:04:05.213717 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 213/415] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:05 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1244 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:06.236926 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-fefd8dfc-9556-4e15-b212-96e5ea2a37a1 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:06.238122 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-fefd8dfc-9556-4e15-b212-96e5ea2a37a1 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:06.252325 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fefd8dfc-9556-4e15-b212-96e5ea2a37a1 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:06.253187 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fefd8dfc-9556-4e15-b212-96e5ea2a37a1 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:06.253973 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fefd8dfc-9556-4e15-b212-96e5ea2a37a1 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:06.255176 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fefd8dfc-9556-4e15-b212-96e5ea2a37a1 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:06.256013 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fefd8dfc-9556-4e15-b212-96e5ea2a37a1 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:06.256771 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fefd8dfc-9556-4e15-b212-96e5ea2a37a1 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:06.334535 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-fefd8dfc-9556-4e15-b212-96e5ea2a37a1 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:06.346855 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-fefd8dfc-9556-4e15-b212-96e5ea2a37a1 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1296 microversion: 2.1 time: 0.114615 Aug 30 01:04:06.347839 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 203/416] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:06 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1296 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:07.372872 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-c3cb7fb8-d8d4-42ed-9ad0-b269c54dc9c7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:07.373697 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-c3cb7fb8-d8d4-42ed-9ad0-b269c54dc9c7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:07.381510 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c3cb7fb8-d8d4-42ed-9ad0-b269c54dc9c7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:07.382382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c3cb7fb8-d8d4-42ed-9ad0-b269c54dc9c7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:07.382822 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c3cb7fb8-d8d4-42ed-9ad0-b269c54dc9c7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:07.383610 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c3cb7fb8-d8d4-42ed-9ad0-b269c54dc9c7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:07.384132 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c3cb7fb8-d8d4-42ed-9ad0-b269c54dc9c7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:07.384755 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c3cb7fb8-d8d4-42ed-9ad0-b269c54dc9c7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:07.532186 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-c3cb7fb8-d8d4-42ed-9ad0-b269c54dc9c7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:07.545242 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-c3cb7fb8-d8d4-42ed-9ad0-b269c54dc9c7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1370 microversion: 2.1 time: 0.176886 Aug 30 01:04:07.546154 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 214/417] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:07 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:07.988172 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-291fec38-8beb-4a1b-be32-edac78490528 req-23ce2b8c-e5ee-429b-8c19-24e893912fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cff4036-ef80-4791-92b5-0c71c8e93582", "tag": "737df1fc-0996-483b-b4f3-e6055a0f4df0"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:07.999831 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-291fec38-8beb-4a1b-be32-edac78490528 req-23ce2b8c-e5ee-429b-8c19-24e893912fd1 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:08.000426 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-291fec38-8beb-4a1b-be32-edac78490528 req-23ce2b8c-e5ee-429b-8c19-24e893912fd1 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:08.000952 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-291fec38-8beb-4a1b-be32-edac78490528 req-23ce2b8c-e5ee-429b-8c19-24e893912fd1 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:08.017633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-291fec38-8beb-4a1b-be32-edac78490528 req-23ce2b8c-e5ee-429b-8c19-24e893912fd1 service nova] Creating event network-changed:737df1fc-0996-483b-b4f3-e6055a0f4df0 for instance 2cff4036-ef80-4791-92b5-0c71c8e93582 on hv-cinder-81514 Aug 30 01:04:08.022950 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-291fec38-8beb-4a1b-be32-edac78490528 req-23ce2b8c-e5ee-429b-8c19-24e893912fd1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038514 Aug 30 01:04:08.023843 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 204/418] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:08.566949 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-57af08b1-30ba-44f5-831b-f7c5456c0e1c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:08.567552 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-57af08b1-30ba-44f5-831b-f7c5456c0e1c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:08.574648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-57af08b1-30ba-44f5-831b-f7c5456c0e1c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:08.575125 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-57af08b1-30ba-44f5-831b-f7c5456c0e1c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:08.575591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-57af08b1-30ba-44f5-831b-f7c5456c0e1c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:08.576275 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-57af08b1-30ba-44f5-831b-f7c5456c0e1c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:08.576764 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-57af08b1-30ba-44f5-831b-f7c5456c0e1c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:08.577279 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-57af08b1-30ba-44f5-831b-f7c5456c0e1c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:08.708695 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-57af08b1-30ba-44f5-831b-f7c5456c0e1c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:08.712269 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:08.721118 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-57af08b1-30ba-44f5-831b-f7c5456c0e1c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1370 microversion: 2.1 time: 0.158156 Aug 30 01:04:08.725232 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 215/419] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:08 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:09.742708 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-16bfe9d6-1742-4891-8cb5-a3482234bfc0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:09.743325 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-16bfe9d6-1742-4891-8cb5-a3482234bfc0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:09.749886 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-16bfe9d6-1742-4891-8cb5-a3482234bfc0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:09.750419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-16bfe9d6-1742-4891-8cb5-a3482234bfc0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:09.750871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-16bfe9d6-1742-4891-8cb5-a3482234bfc0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:09.751581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-16bfe9d6-1742-4891-8cb5-a3482234bfc0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:09.752041 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-16bfe9d6-1742-4891-8cb5-a3482234bfc0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:09.752524 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-16bfe9d6-1742-4891-8cb5-a3482234bfc0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:09.892601 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-16bfe9d6-1742-4891-8cb5-a3482234bfc0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:09.900244 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-16bfe9d6-1742-4891-8cb5-a3482234bfc0 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1370 microversion: 2.1 time: 0.162339 Aug 30 01:04:09.901356 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 205/420] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:09 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:10.922297 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-458d4567-df55-462d-87c7-f338d6842598 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:10.923133 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-458d4567-df55-462d-87c7-f338d6842598 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:10.931410 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-458d4567-df55-462d-87c7-f338d6842598 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:10.931922 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-458d4567-df55-462d-87c7-f338d6842598 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:10.933228 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-458d4567-df55-462d-87c7-f338d6842598 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:10.934051 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-458d4567-df55-462d-87c7-f338d6842598 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:10.934515 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-458d4567-df55-462d-87c7-f338d6842598 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:10.934948 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-458d4567-df55-462d-87c7-f338d6842598 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:11.074520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-458d4567-df55-462d-87c7-f338d6842598 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:11.082304 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-458d4567-df55-462d-87c7-f338d6842598 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1370 microversion: 2.1 time: 0.163995 Aug 30 01:04:11.082789 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 216/421] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:10 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:12.103926 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-6034a7bd-0a9c-4ef3-ba50-e27762844e07 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:12.104754 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-6034a7bd-0a9c-4ef3-ba50-e27762844e07 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:12.111421 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6034a7bd-0a9c-4ef3-ba50-e27762844e07 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:12.111930 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6034a7bd-0a9c-4ef3-ba50-e27762844e07 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:12.112375 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6034a7bd-0a9c-4ef3-ba50-e27762844e07 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:12.113189 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6034a7bd-0a9c-4ef3-ba50-e27762844e07 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:12.113654 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6034a7bd-0a9c-4ef3-ba50-e27762844e07 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:12.114083 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6034a7bd-0a9c-4ef3-ba50-e27762844e07 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:12.247751 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6034a7bd-0a9c-4ef3-ba50-e27762844e07 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:12.255201 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-6034a7bd-0a9c-4ef3-ba50-e27762844e07 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1370 microversion: 2.1 time: 0.155174 Aug 30 01:04:12.255773 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 206/422] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:12 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:12.605801 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8bfe2bc4-05f3-45e5-8d51-a921eec87d2b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:12.606431 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8bfe2bc4-05f3-45e5-8d51-a921eec87d2b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:12.608740 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=2 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:12.614203 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8bfe2bc4-05f3-45e5-8d51-a921eec87d2b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:12.614719 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8bfe2bc4-05f3-45e5-8d51-a921eec87d2b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:12.615192 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8bfe2bc4-05f3-45e5-8d51-a921eec87d2b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:12.615883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8bfe2bc4-05f3-45e5-8d51-a921eec87d2b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:12.616341 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8bfe2bc4-05f3-45e5-8d51-a921eec87d2b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:12.616763 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8bfe2bc4-05f3-45e5-8d51-a921eec87d2b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:12.745303 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8bfe2bc4-05f3-45e5-8d51-a921eec87d2b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:12.753731 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8bfe2bc4-05f3-45e5-8d51-a921eec87d2b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1594 microversion: 2.1 time: 0.152381 Aug 30 01:04:12.754231 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 217/423] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:12 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1594 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:13.193819 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-4103bb45-b15a-42a4-91f6-ef055e6b07b2 req-63c20efa-3139-441c-8d12-50a4a07cd5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cff4036-ef80-4791-92b5-0c71c8e93582", "name": "network-vif-plugged", "status": "completed", "tag": "737df1fc-0996-483b-b4f3-e6055a0f4df0"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:13.207478 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-4103bb45-b15a-42a4-91f6-ef055e6b07b2 req-63c20efa-3139-441c-8d12-50a4a07cd5a6 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:13.208077 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-4103bb45-b15a-42a4-91f6-ef055e6b07b2 req-63c20efa-3139-441c-8d12-50a4a07cd5a6 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:13.208621 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-4103bb45-b15a-42a4-91f6-ef055e6b07b2 req-63c20efa-3139-441c-8d12-50a4a07cd5a6 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:13.222195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-4103bb45-b15a-42a4-91f6-ef055e6b07b2 req-63c20efa-3139-441c-8d12-50a4a07cd5a6 service nova] Creating event network-vif-plugged:737df1fc-0996-483b-b4f3-e6055a0f4df0 for instance 2cff4036-ef80-4791-92b5-0c71c8e93582 on hv-cinder-81514 Aug 30 01:04:13.228027 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-4103bb45-b15a-42a4-91f6-ef055e6b07b2 req-63c20efa-3139-441c-8d12-50a4a07cd5a6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038168 Aug 30 01:04:13.229542 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 207/424] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:13.276461 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-bb987c91-1323-4d20-8991-9623ff549e6b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:13.277557 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-bb987c91-1323-4d20-8991-9623ff549e6b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:13.288193 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bb987c91-1323-4d20-8991-9623ff549e6b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:13.288706 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bb987c91-1323-4d20-8991-9623ff549e6b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:13.289247 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bb987c91-1323-4d20-8991-9623ff549e6b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:13.289970 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bb987c91-1323-4d20-8991-9623ff549e6b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:13.290696 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bb987c91-1323-4d20-8991-9623ff549e6b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:13.291126 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bb987c91-1323-4d20-8991-9623ff549e6b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:13.446034 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-bb987c91-1323-4d20-8991-9623ff549e6b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:13.454417 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-bb987c91-1323-4d20-8991-9623ff549e6b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1370 microversion: 2.1 time: 0.182444 Aug 30 01:04:13.468822 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 218/425] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:13 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:14.476925 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-87d83972-7866-4260-8d3b-87b59275f19a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:14.477654 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-87d83972-7866-4260-8d3b-87b59275f19a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:14.484605 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-87d83972-7866-4260-8d3b-87b59275f19a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:14.485124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-87d83972-7866-4260-8d3b-87b59275f19a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:14.486047 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-87d83972-7866-4260-8d3b-87b59275f19a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:14.487033 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-87d83972-7866-4260-8d3b-87b59275f19a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:14.487611 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-87d83972-7866-4260-8d3b-87b59275f19a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:14.488049 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-87d83972-7866-4260-8d3b-87b59275f19a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:14.624308 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-87d83972-7866-4260-8d3b-87b59275f19a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:14.632077 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-87d83972-7866-4260-8d3b-87b59275f19a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1370 microversion: 2.1 time: 0.159907 Aug 30 01:04:14.632631 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 208/426] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:14 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:15.104602 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-e1492610-df77-4e0d-aec6-f0032189cec7 req-7250e289-1d35-4f21-975f-2c8676e1813d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5598be2a-00db-4303-bc81-a7fb3674e371", "tag": "e2481fa1-2595-4100-98cf-07e796517813"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:15.118499 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-e1492610-df77-4e0d-aec6-f0032189cec7 req-7250e289-1d35-4f21-975f-2c8676e1813d service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:15.120333 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-e1492610-df77-4e0d-aec6-f0032189cec7 req-7250e289-1d35-4f21-975f-2c8676e1813d service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:15.121209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-e1492610-df77-4e0d-aec6-f0032189cec7 req-7250e289-1d35-4f21-975f-2c8676e1813d service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:15.141651 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-e1492610-df77-4e0d-aec6-f0032189cec7 req-7250e289-1d35-4f21-975f-2c8676e1813d service nova] Creating event network-changed:e2481fa1-2595-4100-98cf-07e796517813 for instance 5598be2a-00db-4303-bc81-a7fb3674e371 on hv-cinder-81514 Aug 30 01:04:15.153465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-e1492610-df77-4e0d-aec6-f0032189cec7 req-7250e289-1d35-4f21-975f-2c8676e1813d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053179 Aug 30 01:04:15.156829 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 219/427] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:15.655785 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-cdda59cc-1906-412f-a276-513750533c9c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:15.656424 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-cdda59cc-1906-412f-a276-513750533c9c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:15.660456 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=2 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:15.663565 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=10 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:15.671679 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cdda59cc-1906-412f-a276-513750533c9c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:15.672397 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cdda59cc-1906-412f-a276-513750533c9c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:15.673158 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cdda59cc-1906-412f-a276-513750533c9c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:15.674188 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cdda59cc-1906-412f-a276-513750533c9c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:15.674943 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cdda59cc-1906-412f-a276-513750533c9c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:15.675509 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cdda59cc-1906-412f-a276-513750533c9c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:15.840363 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-cdda59cc-1906-412f-a276-513750533c9c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:15.848417 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-cdda59cc-1906-412f-a276-513750533c9c tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1370 microversion: 2.1 time: 0.197150 Aug 30 01:04:15.848986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 209/428] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:15 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1370 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:16.274982 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-45e36c5f-ab24-44ab-8ecf-aec3474b84df tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1868053050"}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:16.274982 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-45e36c5f-ab24-44ab-8ecf-aec3474b84df tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:16.274982 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=6 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:16.274982 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:16.277139 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-45e36c5f-ab24-44ab-8ecf-aec3474b84df tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:16.277662 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-45e36c5f-ab24-44ab-8ecf-aec3474b84df tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:16.278112 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-45e36c5f-ab24-44ab-8ecf-aec3474b84df tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:16.278805 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-45e36c5f-ab24-44ab-8ecf-aec3474b84df tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:16.279255 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-45e36c5f-ab24-44ab-8ecf-aec3474b84df tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:16.279679 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-45e36c5f-ab24-44ab-8ecf-aec3474b84df tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:16.414205 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.network.security_group_api [None req-45e36c5f-ab24-44ab-8ecf-aec3474b84df tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Adding security group fc98e544-5446-4a9d-95b5-00310bfa492a to port e2481fa1-2595-4100-98cf-07e796517813 Aug 30 01:04:16.738677 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-45e36c5f-ab24-44ab-8ecf-aec3474b84df tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "POST /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371/action" status: 202 len: 0 microversion: 2.1 time: 0.478429 Aug 30 01:04:16.739285 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 220/429] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 30 01:04:16 2022] POST /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:04:16.749101 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-02f8c98c-dd9f-4283-b024-b0e6a3909326 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:16.749519 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-36e8d7bb-e638-449a-89b9-f020d55f03db req-88d4cb60-6633-4281-8ff6-54ecfce4a46a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5598be2a-00db-4303-bc81-a7fb3674e371", "tag": "e2481fa1-2595-4100-98cf-07e796517813"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:16.750467 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-02f8c98c-dd9f-4283-b024-b0e6a3909326 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:16.758456 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-02f8c98c-dd9f-4283-b024-b0e6a3909326 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:16.759052 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-36e8d7bb-e638-449a-89b9-f020d55f03db req-88d4cb60-6633-4281-8ff6-54ecfce4a46a service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:16.759414 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-02f8c98c-dd9f-4283-b024-b0e6a3909326 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:16.759892 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-36e8d7bb-e638-449a-89b9-f020d55f03db req-88d4cb60-6633-4281-8ff6-54ecfce4a46a service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:16.760239 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-02f8c98c-dd9f-4283-b024-b0e6a3909326 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:16.761163 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-02f8c98c-dd9f-4283-b024-b0e6a3909326 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:16.761622 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-36e8d7bb-e638-449a-89b9-f020d55f03db req-88d4cb60-6633-4281-8ff6-54ecfce4a46a service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:16.761962 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-02f8c98c-dd9f-4283-b024-b0e6a3909326 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:16.762521 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-02f8c98c-dd9f-4283-b024-b0e6a3909326 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:16.781762 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-36e8d7bb-e638-449a-89b9-f020d55f03db req-88d4cb60-6633-4281-8ff6-54ecfce4a46a service nova] Creating event network-changed:e2481fa1-2595-4100-98cf-07e796517813 for instance 5598be2a-00db-4303-bc81-a7fb3674e371 on hv-cinder-81514 Aug 30 01:04:16.787477 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-36e8d7bb-e638-449a-89b9-f020d55f03db req-88d4cb60-6633-4281-8ff6-54ecfce4a46a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042497 Aug 30 01:04:16.789498 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 221/430] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:04:16.871838 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-2f363f5c-1f87-4823-8c12-48e48d99aa73 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:16.872656 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-2f363f5c-1f87-4823-8c12-48e48d99aa73 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:16.879067 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2f363f5c-1f87-4823-8c12-48e48d99aa73 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:16.879890 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2f363f5c-1f87-4823-8c12-48e48d99aa73 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:16.880423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2f363f5c-1f87-4823-8c12-48e48d99aa73 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:16.881240 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2f363f5c-1f87-4823-8c12-48e48d99aa73 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:16.881930 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2f363f5c-1f87-4823-8c12-48e48d99aa73 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:16.882432 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2f363f5c-1f87-4823-8c12-48e48d99aa73 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:16.972295 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-02f8c98c-dd9f-4283-b024-b0e6a3909326 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:16.982181 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-02f8c98c-dd9f-4283-b024-b0e6a3909326 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1641 microversion: 2.1 time: 0.238517 Aug 30 01:04:16.982755 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 210/431] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:16 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1641 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:17.051479 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-2f363f5c-1f87-4823-8c12-48e48d99aa73 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:17.071186 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-2f363f5c-1f87-4823-8c12-48e48d99aa73 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1563 microversion: 2.1 time: 0.202714 Aug 30 01:04:17.072062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 222/432] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:16 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1563 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:04:17.097068 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-705d26c5-fcf1-457b-868e-4e358e7f3adf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:17.098384 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-705d26c5-fcf1-457b-868e-4e358e7f3adf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:17.108107 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-705d26c5-fcf1-457b-868e-4e358e7f3adf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:17.108851 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-705d26c5-fcf1-457b-868e-4e358e7f3adf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:17.109596 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-705d26c5-fcf1-457b-868e-4e358e7f3adf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:17.110457 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-705d26c5-fcf1-457b-868e-4e358e7f3adf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:17.111848 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-705d26c5-fcf1-457b-868e-4e358e7f3adf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:17.112798 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-705d26c5-fcf1-457b-868e-4e358e7f3adf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:17.238695 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-705d26c5-fcf1-457b-868e-4e358e7f3adf tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.147210 Aug 30 01:04:17.239733 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 211/433] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 30 01:04:17 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:18.503333 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-4d0aa6c3-028b-4c1b-b60b-3ccefcc70aca req-b9838df3-38c4-4a3f-8a7b-3d3c0c863fda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cff4036-ef80-4791-92b5-0c71c8e93582", "tag": "737df1fc-0996-483b-b4f3-e6055a0f4df0"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:18.513936 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-4d0aa6c3-028b-4c1b-b60b-3ccefcc70aca req-b9838df3-38c4-4a3f-8a7b-3d3c0c863fda service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:18.514713 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-4d0aa6c3-028b-4c1b-b60b-3ccefcc70aca req-b9838df3-38c4-4a3f-8a7b-3d3c0c863fda service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:18.515375 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-4d0aa6c3-028b-4c1b-b60b-3ccefcc70aca req-b9838df3-38c4-4a3f-8a7b-3d3c0c863fda service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:18.527796 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-4d0aa6c3-028b-4c1b-b60b-3ccefcc70aca req-b9838df3-38c4-4a3f-8a7b-3d3c0c863fda service nova] Creating event network-changed:737df1fc-0996-483b-b4f3-e6055a0f4df0 for instance 2cff4036-ef80-4791-92b5-0c71c8e93582 on hv-cinder-81514 Aug 30 01:04:18.532937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-4d0aa6c3-028b-4c1b-b60b-3ccefcc70aca req-b9838df3-38c4-4a3f-8a7b-3d3c0c863fda service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033165 Aug 30 01:04:18.533783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 223/434] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:24.832503 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-55341458-f6a0-41e8-97dd-a3140c6675cd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1999267699", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1418735735", "security_groups": [{"name": "tempest-secgroup-smoke-1850089549"}], "block_device_mapping_v2": [{"uuid": "8157bfa6-0403-47ba-a9da-af7a42ec22e1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9040a016-54c8-479a-991b-4e0ac5fa178d"}]}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:24.961242 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.network.neutron [None req-55341458-f6a0-41e8-97dd-a3140c6675cd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] validate_networks() for [('9040a016-54c8-479a-991b-4e0ac5fa178d', None, None, None, None, None)] {{(pid=120631) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:04:25.336316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-55341458-f6a0-41e8-97dd-a3140c6675cd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Flavor limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:04:25.336737 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-55341458-f6a0-41e8-97dd-a3140c6675cd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Image limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:04:25.337244 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-55341458-f6a0-41e8-97dd-a3140c6675cd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Flavor pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:04:25.337646 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-55341458-f6a0-41e8-97dd-a3140c6675cd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Image pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:04:25.338185 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-55341458-f6a0-41e8-97dd-a3140c6675cd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:04:25.346688 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-55341458-f6a0-41e8-97dd-a3140c6675cd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:25.347179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-55341458-f6a0-41e8-97dd-a3140c6675cd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:25.347605 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-55341458-f6a0-41e8-97dd-a3140c6675cd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:25.348320 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-55341458-f6a0-41e8-97dd-a3140c6675cd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:25.348764 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-55341458-f6a0-41e8-97dd-a3140c6675cd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:25.349205 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-55341458-f6a0-41e8-97dd-a3140c6675cd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:25.365693 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-55341458-f6a0-41e8-97dd-a3140c6675cd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Getting quotas for project a6380baa172744fa9d7ba5b81f847906. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:04:25.370242 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-55341458-f6a0-41e8-97dd-a3140c6675cd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Getting quotas for user d467895d586a43719d2abdf4105187f8 and project a6380baa172744fa9d7ba5b81f847906. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:04:25.429035 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-55341458-f6a0-41e8-97dd-a3140c6675cd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Going to run 1 instances... {{(pid=120631) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:04:25.431199 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-55341458-f6a0-41e8-97dd-a3140c6675cd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8157bfa6-0403-47ba-a9da-af7a42ec22e1',volume_size=None,volume_type=None)] {{(pid=120631) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:04:25.562231 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-55341458-f6a0-41e8-97dd-a3140c6675cd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.734092 Aug 30 01:04:25.562859 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 212/435] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 30 01:04:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:04:25.585233 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-2018caf3-6126-4f5a-adf0-9084656dda43 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:25.585943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-2018caf3-6126-4f5a-adf0-9084656dda43 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:25.640443 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-2018caf3-6126-4f5a-adf0-9084656dda43 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:25.647229 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-2018caf3-6126-4f5a-adf0-9084656dda43 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 200 len: 1095 microversion: 2.1 time: 0.077286 Aug 30 01:04:25.647792 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 224/436] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:25 2022] GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:26.669342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-1814b978-adb5-4725-9767-44fdd0eb7a56 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:26.669980 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-1814b978-adb5-4725-9767-44fdd0eb7a56 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:26.676022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1814b978-adb5-4725-9767-44fdd0eb7a56 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:26.676508 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1814b978-adb5-4725-9767-44fdd0eb7a56 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:26.676939 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1814b978-adb5-4725-9767-44fdd0eb7a56 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:26.677656 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1814b978-adb5-4725-9767-44fdd0eb7a56 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:26.678111 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1814b978-adb5-4725-9767-44fdd0eb7a56 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:26.678535 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1814b978-adb5-4725-9767-44fdd0eb7a56 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:26.743496 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-1814b978-adb5-4725-9767-44fdd0eb7a56 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:26.752509 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-1814b978-adb5-4725-9767-44fdd0eb7a56 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 200 len: 1193 microversion: 2.1 time: 0.088706 Aug 30 01:04:26.753095 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 213/437] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:26 2022] GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 1193 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:27.774019 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4dfc6f8d-9ed0-49cb-98a3-03d0941c3182 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:27.774506 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-4dfc6f8d-9ed0-49cb-98a3-03d0941c3182 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:27.787695 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4dfc6f8d-9ed0-49cb-98a3-03d0941c3182 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:27.788450 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4dfc6f8d-9ed0-49cb-98a3-03d0941c3182 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:27.789053 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4dfc6f8d-9ed0-49cb-98a3-03d0941c3182 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:27.790248 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4dfc6f8d-9ed0-49cb-98a3-03d0941c3182 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:27.790871 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4dfc6f8d-9ed0-49cb-98a3-03d0941c3182 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:27.791466 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4dfc6f8d-9ed0-49cb-98a3-03d0941c3182 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:27.959786 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-4dfc6f8d-9ed0-49cb-98a3-03d0941c3182 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:27.980435 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-4dfc6f8d-9ed0-49cb-98a3-03d0941c3182 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 200 len: 1279 microversion: 2.1 time: 0.210520 Aug 30 01:04:27.981127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 225/438] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:27 2022] GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 1279 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:28.375948 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-c2b0e911-f3db-46f3-8b93-6eb639ac4a09 req-176c9456-8c69-4fce-a865-78f113a1c3fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b85f48c2-35d7-4cab-a969-7e1b1fb4bec7", "tag": "552a6c04-ea5e-4596-976d-aca3794998cd"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:28.386785 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-c2b0e911-f3db-46f3-8b93-6eb639ac4a09 req-176c9456-8c69-4fce-a865-78f113a1c3fd service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:28.387271 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-c2b0e911-f3db-46f3-8b93-6eb639ac4a09 req-176c9456-8c69-4fce-a865-78f113a1c3fd service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:28.387704 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-c2b0e911-f3db-46f3-8b93-6eb639ac4a09 req-176c9456-8c69-4fce-a865-78f113a1c3fd service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:28.399533 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-c2b0e911-f3db-46f3-8b93-6eb639ac4a09 req-176c9456-8c69-4fce-a865-78f113a1c3fd service nova] Creating event network-changed:552a6c04-ea5e-4596-976d-aca3794998cd for instance b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 on hv-cinder-81514 Aug 30 01:04:28.405513 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-c2b0e911-f3db-46f3-8b93-6eb639ac4a09 req-176c9456-8c69-4fce-a865-78f113a1c3fd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033172 Aug 30 01:04:28.406105 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 214/439] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:29.004018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-74aa5ff4-a5df-4ce7-bb54-cfe618ec106c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:29.004635 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-74aa5ff4-a5df-4ce7-bb54-cfe618ec106c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:29.011804 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-74aa5ff4-a5df-4ce7-bb54-cfe618ec106c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:29.012332 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-74aa5ff4-a5df-4ce7-bb54-cfe618ec106c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:29.012772 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-74aa5ff4-a5df-4ce7-bb54-cfe618ec106c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:29.013494 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-74aa5ff4-a5df-4ce7-bb54-cfe618ec106c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:29.013949 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-74aa5ff4-a5df-4ce7-bb54-cfe618ec106c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:29.014378 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-74aa5ff4-a5df-4ce7-bb54-cfe618ec106c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:29.145741 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-74aa5ff4-a5df-4ce7-bb54-cfe618ec106c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:29.153978 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-74aa5ff4-a5df-4ce7-bb54-cfe618ec106c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 200 len: 1267 microversion: 2.1 time: 0.153944 Aug 30 01:04:29.154543 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 226/440] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:28 2022] GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:30.176757 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-4fae9584-0ff8-4464-a0a3-66ac4d2b7368 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:30.177511 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-4fae9584-0ff8-4464-a0a3-66ac4d2b7368 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:30.184863 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4fae9584-0ff8-4464-a0a3-66ac4d2b7368 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:30.185375 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4fae9584-0ff8-4464-a0a3-66ac4d2b7368 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:30.185811 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4fae9584-0ff8-4464-a0a3-66ac4d2b7368 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:30.186502 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4fae9584-0ff8-4464-a0a3-66ac4d2b7368 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:30.186954 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4fae9584-0ff8-4464-a0a3-66ac4d2b7368 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:30.187379 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4fae9584-0ff8-4464-a0a3-66ac4d2b7368 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:30.320459 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-4fae9584-0ff8-4464-a0a3-66ac4d2b7368 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:30.328643 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-4fae9584-0ff8-4464-a0a3-66ac4d2b7368 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 200 len: 1267 microversion: 2.1 time: 0.156564 Aug 30 01:04:30.329228 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 215/441] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:30 2022] GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:31.349587 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-84d8ed18-a69f-4afa-8c97-a2f1ddbc092e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:31.350197 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-84d8ed18-a69f-4afa-8c97-a2f1ddbc092e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:31.357184 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-84d8ed18-a69f-4afa-8c97-a2f1ddbc092e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:31.357670 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-84d8ed18-a69f-4afa-8c97-a2f1ddbc092e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:31.358105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-84d8ed18-a69f-4afa-8c97-a2f1ddbc092e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:31.358789 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-84d8ed18-a69f-4afa-8c97-a2f1ddbc092e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:31.359239 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-84d8ed18-a69f-4afa-8c97-a2f1ddbc092e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:31.359666 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-84d8ed18-a69f-4afa-8c97-a2f1ddbc092e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:31.491838 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-84d8ed18-a69f-4afa-8c97-a2f1ddbc092e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:31.500189 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-84d8ed18-a69f-4afa-8c97-a2f1ddbc092e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 200 len: 1267 microversion: 2.1 time: 0.154379 Aug 30 01:04:31.500757 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 227/442] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:31 2022] GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:32.521115 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-d5df0e1f-7972-4fc6-a087-54de23482c00 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:32.521724 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-d5df0e1f-7972-4fc6-a087-54de23482c00 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:32.524140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=7 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:32.529920 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d5df0e1f-7972-4fc6-a087-54de23482c00 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:32.530395 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d5df0e1f-7972-4fc6-a087-54de23482c00 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:32.530825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d5df0e1f-7972-4fc6-a087-54de23482c00 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:32.531507 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d5df0e1f-7972-4fc6-a087-54de23482c00 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:32.531952 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d5df0e1f-7972-4fc6-a087-54de23482c00 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:32.532370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d5df0e1f-7972-4fc6-a087-54de23482c00 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:32.535645 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=69 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:32.665566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-d5df0e1f-7972-4fc6-a087-54de23482c00 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:32.673771 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-d5df0e1f-7972-4fc6-a087-54de23482c00 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 200 len: 1267 microversion: 2.1 time: 0.156518 Aug 30 01:04:32.674324 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 216/443] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:32 2022] GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:33.694580 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f7b8be45-287d-4ec1-a931-b647e4a53564 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:33.695309 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-f7b8be45-287d-4ec1-a931-b647e4a53564 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:33.702430 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f7b8be45-287d-4ec1-a931-b647e4a53564 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:33.702914 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f7b8be45-287d-4ec1-a931-b647e4a53564 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:33.703345 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f7b8be45-287d-4ec1-a931-b647e4a53564 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:33.704026 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f7b8be45-287d-4ec1-a931-b647e4a53564 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:33.704474 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f7b8be45-287d-4ec1-a931-b647e4a53564 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:33.704893 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f7b8be45-287d-4ec1-a931-b647e4a53564 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:33.832840 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-f7b8be45-287d-4ec1-a931-b647e4a53564 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:33.841150 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-f7b8be45-287d-4ec1-a931-b647e4a53564 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 200 len: 1267 microversion: 2.1 time: 0.150331 Aug 30 01:04:33.841717 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 228/444] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:33 2022] GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:34.862188 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-219b4955-fe69-4ede-8332-04e9e0694b0a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:34.862798 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-219b4955-fe69-4ede-8332-04e9e0694b0a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:34.869160 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-219b4955-fe69-4ede-8332-04e9e0694b0a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:34.869637 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-219b4955-fe69-4ede-8332-04e9e0694b0a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:34.870113 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-219b4955-fe69-4ede-8332-04e9e0694b0a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:34.870793 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-219b4955-fe69-4ede-8332-04e9e0694b0a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:34.871241 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-219b4955-fe69-4ede-8332-04e9e0694b0a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:34.871658 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-219b4955-fe69-4ede-8332-04e9e0694b0a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:35.005820 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-219b4955-fe69-4ede-8332-04e9e0694b0a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:35.013637 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-219b4955-fe69-4ede-8332-04e9e0694b0a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 200 len: 1267 microversion: 2.1 time: 0.155266 Aug 30 01:04:35.014235 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 217/445] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:34 2022] GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:36.034662 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-84864ae1-e725-4329-9629-09ec147085c6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:36.035272 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-84864ae1-e725-4329-9629-09ec147085c6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:36.037752 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=2 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:36.043872 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-84864ae1-e725-4329-9629-09ec147085c6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:36.044360 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-84864ae1-e725-4329-9629-09ec147085c6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:36.044800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-84864ae1-e725-4329-9629-09ec147085c6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:36.045530 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-84864ae1-e725-4329-9629-09ec147085c6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:36.045986 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-84864ae1-e725-4329-9629-09ec147085c6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:36.046410 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-84864ae1-e725-4329-9629-09ec147085c6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:36.178841 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-84864ae1-e725-4329-9629-09ec147085c6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:36.187406 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-84864ae1-e725-4329-9629-09ec147085c6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 200 len: 1267 microversion: 2.1 time: 0.156585 Aug 30 01:04:36.187904 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 229/446] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:36 2022] GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:37.207932 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3c43e61f-520f-4bb2-9048-80788625da54 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:37.208539 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-3c43e61f-520f-4bb2-9048-80788625da54 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:37.210682 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=2 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:37.211358 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=6 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:37.218696 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3c43e61f-520f-4bb2-9048-80788625da54 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:37.219192 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3c43e61f-520f-4bb2-9048-80788625da54 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:37.219676 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3c43e61f-520f-4bb2-9048-80788625da54 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:37.220416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3c43e61f-520f-4bb2-9048-80788625da54 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:37.220875 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3c43e61f-520f-4bb2-9048-80788625da54 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:37.221383 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3c43e61f-520f-4bb2-9048-80788625da54 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:37.356935 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3c43e61f-520f-4bb2-9048-80788625da54 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:37.364800 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3c43e61f-520f-4bb2-9048-80788625da54 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 200 len: 1267 microversion: 2.1 time: 0.160871 Aug 30 01:04:37.365390 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 218/447] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:37 2022] GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:38.384909 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-65b247a0-453c-40d9-9c5e-10350035e3aa tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:38.385545 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-65b247a0-453c-40d9-9c5e-10350035e3aa tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:38.392357 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-65b247a0-453c-40d9-9c5e-10350035e3aa tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:38.392835 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-65b247a0-453c-40d9-9c5e-10350035e3aa tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:38.393306 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-65b247a0-453c-40d9-9c5e-10350035e3aa tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:38.393995 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-65b247a0-453c-40d9-9c5e-10350035e3aa tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:38.394441 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-65b247a0-453c-40d9-9c5e-10350035e3aa tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:38.394860 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-65b247a0-453c-40d9-9c5e-10350035e3aa tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:38.525687 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-65b247a0-453c-40d9-9c5e-10350035e3aa tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:38.533912 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-65b247a0-453c-40d9-9c5e-10350035e3aa tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 200 len: 1267 microversion: 2.1 time: 0.152873 Aug 30 01:04:38.534465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 230/448] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:38 2022] GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:39.254777 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-8ec769ed-aa0b-492f-b595-4546f08fc33d req-41d66cde-f358-4fb2-88be-041ada01da4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b85f48c2-35d7-4cab-a969-7e1b1fb4bec7", "name": "network-vif-plugged", "status": "completed", "tag": "552a6c04-ea5e-4596-976d-aca3794998cd"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:39.269066 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-8ec769ed-aa0b-492f-b595-4546f08fc33d req-41d66cde-f358-4fb2-88be-041ada01da4e service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:39.269633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-8ec769ed-aa0b-492f-b595-4546f08fc33d req-41d66cde-f358-4fb2-88be-041ada01da4e service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:39.270543 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-8ec769ed-aa0b-492f-b595-4546f08fc33d req-41d66cde-f358-4fb2-88be-041ada01da4e service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:39.283106 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-8ec769ed-aa0b-492f-b595-4546f08fc33d req-41d66cde-f358-4fb2-88be-041ada01da4e service nova] Creating event network-vif-plugged:552a6c04-ea5e-4596-976d-aca3794998cd for instance b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 on hv-cinder-81514 Aug 30 01:04:39.288174 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-8ec769ed-aa0b-492f-b595-4546f08fc33d req-41d66cde-f358-4fb2-88be-041ada01da4e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037184 Aug 30 01:04:39.288933 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 219/449] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:39.555758 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-b3bbfb1c-5430-4a71-900b-8752c47aa9e5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:39.556383 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-b3bbfb1c-5430-4a71-900b-8752c47aa9e5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:39.563445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b3bbfb1c-5430-4a71-900b-8752c47aa9e5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:39.563937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b3bbfb1c-5430-4a71-900b-8752c47aa9e5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:39.564376 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b3bbfb1c-5430-4a71-900b-8752c47aa9e5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:39.565099 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b3bbfb1c-5430-4a71-900b-8752c47aa9e5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:39.565552 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b3bbfb1c-5430-4a71-900b-8752c47aa9e5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:39.566341 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b3bbfb1c-5430-4a71-900b-8752c47aa9e5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:39.695082 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-b3bbfb1c-5430-4a71-900b-8752c47aa9e5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:39.702801 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-b3bbfb1c-5430-4a71-900b-8752c47aa9e5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 200 len: 1267 microversion: 2.1 time: 0.150947 Aug 30 01:04:39.703373 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 231/450] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:39 2022] GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:40.724199 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-a38ffc52-7081-4459-a771-9a096f54cfa7 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:40.724885 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-a38ffc52-7081-4459-a771-9a096f54cfa7 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:40.732094 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a38ffc52-7081-4459-a771-9a096f54cfa7 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:40.732569 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a38ffc52-7081-4459-a771-9a096f54cfa7 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:40.733000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a38ffc52-7081-4459-a771-9a096f54cfa7 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:40.733743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a38ffc52-7081-4459-a771-9a096f54cfa7 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:40.734192 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a38ffc52-7081-4459-a771-9a096f54cfa7 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:40.734636 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a38ffc52-7081-4459-a771-9a096f54cfa7 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:40.872689 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-a38ffc52-7081-4459-a771-9a096f54cfa7 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:40.880401 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-a38ffc52-7081-4459-a771-9a096f54cfa7 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 200 len: 1267 microversion: 2.1 time: 0.160398 Aug 30 01:04:40.880967 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 220/451] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:40 2022] GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:41.901681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-44c60fd0-3471-43c1-9849-7fb56b8d6815 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:41.902626 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-44c60fd0-3471-43c1-9849-7fb56b8d6815 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:41.908989 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-44c60fd0-3471-43c1-9849-7fb56b8d6815 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:41.909505 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-44c60fd0-3471-43c1-9849-7fb56b8d6815 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:41.909945 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-44c60fd0-3471-43c1-9849-7fb56b8d6815 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:41.910629 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-44c60fd0-3471-43c1-9849-7fb56b8d6815 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:41.911082 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-44c60fd0-3471-43c1-9849-7fb56b8d6815 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:41.911505 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-44c60fd0-3471-43c1-9849-7fb56b8d6815 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:41.914065 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=77 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:42.040872 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-44c60fd0-3471-43c1-9849-7fb56b8d6815 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:42.048608 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-44c60fd0-3471-43c1-9849-7fb56b8d6815 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 200 len: 1455 microversion: 2.1 time: 0.150755 Aug 30 01:04:42.049187 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 232/452] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:41 2022] GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:42.069043 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-f0759a60-d9d0-476f-9c1f-fa74a1a7577d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:42.069675 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-f0759a60-d9d0-476f-9c1f-fa74a1a7577d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:42.076846 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f0759a60-d9d0-476f-9c1f-fa74a1a7577d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:42.077359 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f0759a60-d9d0-476f-9c1f-fa74a1a7577d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:42.077796 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f0759a60-d9d0-476f-9c1f-fa74a1a7577d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:42.078489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f0759a60-d9d0-476f-9c1f-fa74a1a7577d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:42.078954 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f0759a60-d9d0-476f-9c1f-fa74a1a7577d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:42.079376 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f0759a60-d9d0-476f-9c1f-fa74a1a7577d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:42.216353 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-f0759a60-d9d0-476f-9c1f-fa74a1a7577d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:42.224221 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-f0759a60-d9d0-476f-9c1f-fa74a1a7577d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 200 len: 1455 microversion: 2.1 time: 0.159014 Aug 30 01:04:42.224799 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 221/453] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:42 2022] GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:43.985470 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-8290e9bb-d3a5-4c45-ade1-8d08647fe250 req-4af8e9f4-8880-465c-a635-6d11b65a5e4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b85f48c2-35d7-4cab-a969-7e1b1fb4bec7", "tag": "552a6c04-ea5e-4596-976d-aca3794998cd"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:43.995940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-8290e9bb-d3a5-4c45-ade1-8d08647fe250 req-4af8e9f4-8880-465c-a635-6d11b65a5e4a service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:43.996551 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-8290e9bb-d3a5-4c45-ade1-8d08647fe250 req-4af8e9f4-8880-465c-a635-6d11b65a5e4a service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:43.996980 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-8290e9bb-d3a5-4c45-ade1-8d08647fe250 req-4af8e9f4-8880-465c-a635-6d11b65a5e4a service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:44.007900 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-8290e9bb-d3a5-4c45-ade1-8d08647fe250 req-4af8e9f4-8880-465c-a635-6d11b65a5e4a service nova] Creating event network-changed:552a6c04-ea5e-4596-976d-aca3794998cd for instance b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 on hv-cinder-81514 Aug 30 01:04:44.013553 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-8290e9bb-d3a5-4c45-ade1-8d08647fe250 req-4af8e9f4-8880-465c-a635-6d11b65a5e4a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031651 Aug 30 01:04:44.014137 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 233/454] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:53.217174 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-fe4b6261-dc58-457e-8a10-869cb34e9555 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:53.217764 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-fe4b6261-dc58-457e-8a10-869cb34e9555 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:53.220295 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=11 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:53.220949 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=31 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:53.226935 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fe4b6261-dc58-457e-8a10-869cb34e9555 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:53.227423 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fe4b6261-dc58-457e-8a10-869cb34e9555 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:53.227858 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fe4b6261-dc58-457e-8a10-869cb34e9555 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:53.228557 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fe4b6261-dc58-457e-8a10-869cb34e9555 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:53.229012 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fe4b6261-dc58-457e-8a10-869cb34e9555 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:53.229465 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fe4b6261-dc58-457e-8a10-869cb34e9555 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:53.254310 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-fe4b6261-dc58-457e-8a10-869cb34e9555 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2/ips" status: 200 len: 149 microversion: 2.1 time: 0.042051 Aug 30 01:04:53.254913 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 222/455] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 30 01:04:53 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:53.268339 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-76a23da3-0ad3-4abb-abfb-f96410800a0d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f7cf8ad-eb76-4276-bbe3-3008de1d4538"}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:53.270815 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-76a23da3-0ad3-4abb-abfb-f96410800a0d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:53.272807 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=30 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:53.278643 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-76a23da3-0ad3-4abb-abfb-f96410800a0d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:53.279116 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-76a23da3-0ad3-4abb-abfb-f96410800a0d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:53.279545 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-76a23da3-0ad3-4abb-abfb-f96410800a0d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:53.280225 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-76a23da3-0ad3-4abb-abfb-f96410800a0d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:53.280671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-76a23da3-0ad3-4abb-abfb-f96410800a0d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:53.281112 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-76a23da3-0ad3-4abb-abfb-f96410800a0d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:53.363229 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-76a23da3-0ad3-4abb-abfb-f96410800a0d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] HTTP exception thrown: Invalid volume: volume 4f7cf8ad-eb76-4276-bbe3-3008de1d4538 is already attached to instances: 8d2ed1b9-2567-4964-83fd-dd44533766ae Aug 30 01:04:53.364943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-76a23da3-0ad3-4abb-abfb-f96410800a0d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Request method failure captured: Aug 30 01:04:53.364943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: POST /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2/os-volume_attachments HTTP/1.1 Aug 30 01:04:53.364943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:04:53.364943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:04:53.364943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:04:53.364943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 74 Aug 30 01:04:53.364943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:04:53.364943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:04:53.364943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:04:53.364943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:04:53.364943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWFfZmUwgQ0mFuieojBsvktSnruxexkMD8R8bd6MnZKGHmPnXPTUGPvemFUgtcXUu8u-yzCNpJULMfiAasm8f-KjX-nH3CChWEIyCAavljtkV9ICnALTHbbll4hz4f_VNsMQOGGKv1XAa5uQHI8I8bGS718FQfoeBt-22Hj_CVvvdxo Aug 30 01:04:53.364943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:04:53.364943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:04:53.364943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:04:53.364943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:04:53.364943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:04:53.364943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:04:53.364943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:04:53.364943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:04:53.364943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:04:53.364943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:04:53.366536 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0596692dbfb149139a1e72159c6f93db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}] Aug 30 01:04:53.366536 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:04:53.366536 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:04:53.366536 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:04:53.366536 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:04:53.366536 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:04:53.366536 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:04:53.366536 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: cc7cf306aadb45d1b65252b53c86b612 Aug 30 01:04:53.366536 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:04:53.366536 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Aug 30 01:04:53.366536 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {"volumeAttachment": {"volumeId": "4f7cf8ad-eb76-4276-bbe3-3008de1d4538"}} Aug 30 01:04:53.366536 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:04:53.367423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Invalid volume: volume 4f7cf8ad-eb76-4276-bbe3-3008de1d4538 is already attached to instances: 8d2ed1b9-2567-4964-83fd-dd44533766ae Aug 30 01:04:53.367423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'server_id': '0f9ce423-87fe-4742-ab18-537e725fb3c2', 'body': {'volumeAttachment': {'volumeId': '4f7cf8ad-eb76-4276-bbe3-3008de1d4538'}}} Aug 30 01:04:53.367423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:04:53.367423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:53.367423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 01:04:53.367423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 01:04:53.367423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 01:04:53.367423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 01:04:53.367423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 01:04:53.367423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 01:04:53.367423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 01:04:53.367423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 01:04:53.367423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 01:04:53.367423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 01:04:53.367423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4f7cf8ad-eb76-4276-bbe3-3008de1d4538 is already attached to instances: 8d2ed1b9-2567-4964-83fd-dd44533766ae Aug 30 01:04:53.367423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:04:53.367423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:04:53.367423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:04:53.367423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:53.368591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:04:53.368591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:04:53.368591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:04:53.368591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:04:53.368591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:04:53.368591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:04:53.368591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:04:53.368591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:04:53.368591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:04:53.368591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:04:53.368591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:04:53.368591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:04:53.368591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 01:04:53.368591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 01:04:53.368591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4f7cf8ad-eb76-4276-bbe3-3008de1d4538 is already attached to instances: 8d2ed1b9-2567-4964-83fd-dd44533766ae Aug 30 01:04:53.368591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:04:53.368591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:04:53.368591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:04:53.368591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:53.368591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:04:53.369783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:04:53.369783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:04:53.369783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:04:53.369783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4f7cf8ad-eb76-4276-bbe3-3008de1d4538 is already attached to instances: 8d2ed1b9-2567-4964-83fd-dd44533766ae Aug 30 01:04:53.369783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:04:53.369783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-76a23da3-0ad3-4abb-abfb-f96410800a0d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Returning 400 to user: Invalid volume: volume 4f7cf8ad-eb76-4276-bbe3-3008de1d4538 is already attached to instances: 8d2ed1b9-2567-4964-83fd-dd44533766ae {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:04:53.369783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-76a23da3-0ad3-4abb-abfb-f96410800a0d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "POST /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103122 Aug 30 01:04:53.369783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 234/456] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 30 01:04:53 2022] POST /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:04:53.375730 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-1c949f89-0c32-4204-b1c3-8ee038051026 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:53.376242 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-1c949f89-0c32-4204-b1c3-8ee038051026 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:53.382144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1c949f89-0c32-4204-b1c3-8ee038051026 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:53.382607 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1c949f89-0c32-4204-b1c3-8ee038051026 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:53.383035 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1c949f89-0c32-4204-b1c3-8ee038051026 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:53.383712 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1c949f89-0c32-4204-b1c3-8ee038051026 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:53.384156 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1c949f89-0c32-4204-b1c3-8ee038051026 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:53.384572 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1c949f89-0c32-4204-b1c3-8ee038051026 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:53.410410 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-1c949f89-0c32-4204-b1c3-8ee038051026 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Going to try to terminate instance {{(pid=120631) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:04:53.484702 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-1c949f89-0c32-4204-b1c3-8ee038051026 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 204 len: 0 microversion: 2.1 time: 0.112453 Aug 30 01:04:53.485235 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 223/457] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:04:53 2022] DELETE /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:04:53.493253 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-9a63c272-8b6a-4b76-ad79-d31de062075b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:53.493868 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-9a63c272-8b6a-4b76-ad79-d31de062075b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:53.500050 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9a63c272-8b6a-4b76-ad79-d31de062075b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:53.500538 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9a63c272-8b6a-4b76-ad79-d31de062075b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:53.500976 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9a63c272-8b6a-4b76-ad79-d31de062075b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:53.501702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9a63c272-8b6a-4b76-ad79-d31de062075b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:53.502157 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9a63c272-8b6a-4b76-ad79-d31de062075b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:53.502590 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9a63c272-8b6a-4b76-ad79-d31de062075b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:53.629717 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-9a63c272-8b6a-4b76-ad79-d31de062075b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:53.638094 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-9a63c272-8b6a-4b76-ad79-d31de062075b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 200 len: 1680 microversion: 2.1 time: 0.148699 Aug 30 01:04:53.638651 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 235/458] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:53 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:54.660293 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-79329031-7188-4cd8-8f40-303bf5e4756f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:54.660986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-79329031-7188-4cd8-8f40-303bf5e4756f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:54.667605 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-79329031-7188-4cd8-8f40-303bf5e4756f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:54.668081 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-79329031-7188-4cd8-8f40-303bf5e4756f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:54.668518 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-79329031-7188-4cd8-8f40-303bf5e4756f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:54.669250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-79329031-7188-4cd8-8f40-303bf5e4756f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:54.669701 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-79329031-7188-4cd8-8f40-303bf5e4756f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:54.670121 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-79329031-7188-4cd8-8f40-303bf5e4756f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:54.804934 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-79329031-7188-4cd8-8f40-303bf5e4756f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:54.813945 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-79329031-7188-4cd8-8f40-303bf5e4756f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 200 len: 1680 microversion: 2.1 time: 0.157784 Aug 30 01:04:54.814447 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 224/459] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:54 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:55.835008 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-e6ebb538-23e9-4216-b36b-121c584695f7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:55.835631 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-e6ebb538-23e9-4216-b36b-121c584695f7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:55.842416 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e6ebb538-23e9-4216-b36b-121c584695f7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:55.842912 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e6ebb538-23e9-4216-b36b-121c584695f7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:55.843354 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e6ebb538-23e9-4216-b36b-121c584695f7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:55.844049 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e6ebb538-23e9-4216-b36b-121c584695f7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:55.844507 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e6ebb538-23e9-4216-b36b-121c584695f7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:55.844934 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e6ebb538-23e9-4216-b36b-121c584695f7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:55.977851 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-e6ebb538-23e9-4216-b36b-121c584695f7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:55.986222 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-e6ebb538-23e9-4216-b36b-121c584695f7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 200 len: 1680 microversion: 2.1 time: 0.155068 Aug 30 01:04:55.986802 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 236/460] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:55 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:56.564709 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-b0ff0b77-f67a-4df6-936b-e8ea087487d1 req-5cb1f9ff-a22f-4ab9-ac22-d981032bb144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9ce423-87fe-4742-ab18-537e725fb3c2", "name": "network-vif-deleted", "tag": "f0e1db00-4448-4f4f-865f-c2f369d94a25"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:56.577573 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-b0ff0b77-f67a-4df6-936b-e8ea087487d1 req-5cb1f9ff-a22f-4ab9-ac22-d981032bb144 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:56.578170 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-b0ff0b77-f67a-4df6-936b-e8ea087487d1 req-5cb1f9ff-a22f-4ab9-ac22-d981032bb144 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:56.578679 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-b0ff0b77-f67a-4df6-936b-e8ea087487d1 req-5cb1f9ff-a22f-4ab9-ac22-d981032bb144 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:56.591825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-b0ff0b77-f67a-4df6-936b-e8ea087487d1 req-5cb1f9ff-a22f-4ab9-ac22-d981032bb144 service nova] Creating event network-vif-deleted:f0e1db00-4448-4f4f-865f-c2f369d94a25 for instance 0f9ce423-87fe-4742-ab18-537e725fb3c2 on hv-cinder-81514 Aug 30 01:04:56.597373 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-b0ff0b77-f67a-4df6-936b-e8ea087487d1 req-5cb1f9ff-a22f-4ab9-ac22-d981032bb144 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036282 Aug 30 01:04:56.598417 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 225/461] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:57.008126 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-e5d0cbdd-bb1d-4443-bd85-c46d402bcabf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:57.008904 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-e5d0cbdd-bb1d-4443-bd85-c46d402bcabf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:57.015969 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e5d0cbdd-bb1d-4443-bd85-c46d402bcabf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:57.016732 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e5d0cbdd-bb1d-4443-bd85-c46d402bcabf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:57.017500 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e5d0cbdd-bb1d-4443-bd85-c46d402bcabf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:57.018446 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e5d0cbdd-bb1d-4443-bd85-c46d402bcabf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:57.018985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e5d0cbdd-bb1d-4443-bd85-c46d402bcabf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:57.019605 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e5d0cbdd-bb1d-4443-bd85-c46d402bcabf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:57.053163 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e5d0cbdd-bb1d-4443-bd85-c46d402bcabf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:57.053877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e5d0cbdd-bb1d-4443-bd85-c46d402bcabf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:57.054450 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e5d0cbdd-bb1d-4443-bd85-c46d402bcabf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:57.055032 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.objects.instance [None req-e5d0cbdd-bb1d-4443-bd85-c46d402bcabf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lazy-loading 'fault' on Instance uuid 0f9ce423-87fe-4742-ab18-537e725fb3c2 {{(pid=120630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:04:57.099428 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-e5d0cbdd-bb1d-4443-bd85-c46d402bcabf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:57.107429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-e5d0cbdd-bb1d-4443-bd85-c46d402bcabf tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 200 len: 1330 microversion: 2.1 time: 0.103478 Aug 30 01:04:57.107997 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 237/462] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:57 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:58.130203 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-c8092803-0e01-4be2-9277-36d63e26e213 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:58.131045 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-c8092803-0e01-4be2-9277-36d63e26e213 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:58.137934 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c8092803-0e01-4be2-9277-36d63e26e213 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:58.138974 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c8092803-0e01-4be2-9277-36d63e26e213 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:58.139413 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c8092803-0e01-4be2-9277-36d63e26e213 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:58.140110 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c8092803-0e01-4be2-9277-36d63e26e213 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:58.140598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c8092803-0e01-4be2-9277-36d63e26e213 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:58.141020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c8092803-0e01-4be2-9277-36d63e26e213 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:58.155030 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-c8092803-0e01-4be2-9277-36d63e26e213 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] HTTP exception thrown: Instance 0f9ce423-87fe-4742-ab18-537e725fb3c2 could not be found. Aug 30 01:04:58.156593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-c8092803-0e01-4be2-9277-36d63e26e213 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Request method failure captured: Aug 30 01:04:58.156593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 HTTP/1.1 Aug 30 01:04:58.156593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:04:58.156593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:04:58.156593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:04:58.156593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:04:58.156593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:04:58.156593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:04:58.156593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:04:58.156593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:04:58.156593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWFfZmUwgQ0mFuieojBsvktSnruxexkMD8R8bd6MnZKGHmPnXPTUGPvemFUgtcXUu8u-yzCNpJULMfiAasm8f-KjX-nH3CChWEIyCAavljtkV9ICnALTHbbll4hz4f_VNsMQOGGKv1XAa5uQHI8I8bGS718FQfoeBt-22Hj_CVvvdxo Aug 30 01:04:58.156593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:04:58.156593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:04:58.156593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:04:58.156593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:04:58.156593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:04:58.156593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:04:58.156593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:04:58.156593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:04:58.156593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:04:58.156593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:04:58.158169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0596692dbfb149139a1e72159c6f93db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}] Aug 30 01:04:58.158169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:04:58.158169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:04:58.158169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:04:58.158169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:04:58.158169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:04:58.158169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:04:58.158169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: cc7cf306aadb45d1b65252b53c86b612 Aug 30 01:04:58.158169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:04:58.158169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:04:58.158169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Instance 0f9ce423-87fe-4742-ab18-537e725fb3c2 could not be found. Aug 30 01:04:58.158169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': '0f9ce423-87fe-4742-ab18-537e725fb3c2'} Aug 30 01:04:58.158940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:04:58.158940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:58.158940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:04:58.158940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:04:58.158940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:04:58.158940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:04:58.158940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:04:58.158940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:04:58.158940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:04:58.158940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:04:58.158940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f9ce423-87fe-4742-ab18-537e725fb3c2 could not be found. Aug 30 01:04:58.158940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:04:58.158940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:04:58.158940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:04:58.158940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:58.158940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:04:58.158940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:04:58.158940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:04:58.158940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:04:58.158940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:04:58.160177 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:04:58.160177 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:04:58.160177 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:04:58.160177 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:04:58.160177 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:04:58.160177 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:04:58.160177 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:04:58.160177 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f9ce423-87fe-4742-ab18-537e725fb3c2 could not be found. Aug 30 01:04:58.160177 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:04:58.160177 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:04:58.160177 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:04:58.160177 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:58.160177 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:04:58.160177 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:04:58.160177 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:04:58.160177 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:04:58.160177 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f9ce423-87fe-4742-ab18-537e725fb3c2 could not be found. Aug 30 01:04:58.160177 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:04:58.161308 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-c8092803-0e01-4be2-9277-36d63e26e213 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Returning 404 to user: Instance 0f9ce423-87fe-4742-ab18-537e725fb3c2 could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:04:58.161308 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-c8092803-0e01-4be2-9277-36d63e26e213 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 404 len: 111 microversion: 2.1 time: 0.033137 Aug 30 01:04:58.161308 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 226/463] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:58 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:04:58.167132 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-9b94b111-1f5f-4b01-b029-0647c849525d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '.version_select at 0x7f0f52b31d30>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:58.188297 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-9b94b111-1f5f-4b01-b029-0647c849525d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1827563118" status: 202 len: 0 microversion: 2.1 time: 0.025097 Aug 30 01:04:58.188874 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 238/464] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Aug 30 01:04:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1827563118 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:04:58.284688 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-f3e857b4-94e4-4a0e-a070-9317bf6896f1 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:58.285237 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-f3e857b4-94e4-4a0e-a070-9317bf6896f1 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:58.291635 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f3e857b4-94e4-4a0e-a070-9317bf6896f1 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:58.292120 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f3e857b4-94e4-4a0e-a070-9317bf6896f1 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:58.292557 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f3e857b4-94e4-4a0e-a070-9317bf6896f1 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:58.293629 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f3e857b4-94e4-4a0e-a070-9317bf6896f1 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:58.293919 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f3e857b4-94e4-4a0e-a070-9317bf6896f1 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:58.294631 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f3e857b4-94e4-4a0e-a070-9317bf6896f1 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:58.428286 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.objects.instance [None req-f3e857b4-94e4-4a0e-a070-9317bf6896f1 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lazy-loading 'services' on Instance uuid b59fedac-4fcb-47a8-8187-0a331d499fd2 {{(pid=120631) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:04:58.552825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-f3e857b4-94e4-4a0e-a070-9317bf6896f1 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2/os-volume_attachments/8c19e17b-193c-4d03-be52-4913b5358bde" status: 202 len: 0 microversion: 2.1 time: 0.271985 Aug 30 01:04:58.553494 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 227/465] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 30 01:04:58 2022] DELETE /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2/os-volume_attachments/8c19e17b-193c-4d03-be52-4913b5358bde => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:04:58.900665 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-54d7e92e-b62b-4296-9c5b-27a3bd1df30d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:58.901186 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-54d7e92e-b62b-4296-9c5b-27a3bd1df30d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:58.908571 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-54d7e92e-b62b-4296-9c5b-27a3bd1df30d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:58.909060 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-54d7e92e-b62b-4296-9c5b-27a3bd1df30d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:58.909522 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-54d7e92e-b62b-4296-9c5b-27a3bd1df30d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:58.910214 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-54d7e92e-b62b-4296-9c5b-27a3bd1df30d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:58.910667 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-54d7e92e-b62b-4296-9c5b-27a3bd1df30d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:58.911093 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-54d7e92e-b62b-4296-9c5b-27a3bd1df30d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:59.033677 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.objects.instance [None req-54d7e92e-b62b-4296-9c5b-27a3bd1df30d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lazy-loading 'services' on Instance uuid 8d2ed1b9-2567-4964-83fd-dd44533766ae {{(pid=120630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:04:59.150279 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-54d7e92e-b62b-4296-9c5b-27a3bd1df30d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae/os-volume_attachments/4f7cf8ad-eb76-4276-bbe3-3008de1d4538" status: 202 len: 0 microversion: 2.1 time: 0.253336 Aug 30 01:04:59.150864 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 239/466] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 30 01:04:58 2022] DELETE /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae/os-volume_attachments/4f7cf8ad-eb76-4276-bbe3-3008de1d4538 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:04:59.160765 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-24a7cf79-025b-4966-8836-4d5c4ac96b8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:59.163139 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-24a7cf79-025b-4966-8836-4d5c4ac96b8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:59.171269 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-24a7cf79-025b-4966-8836-4d5c4ac96b8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:59.171791 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-24a7cf79-025b-4966-8836-4d5c4ac96b8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:59.172206 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-24a7cf79-025b-4966-8836-4d5c4ac96b8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:59.172902 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-24a7cf79-025b-4966-8836-4d5c4ac96b8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:59.173754 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-24a7cf79-025b-4966-8836-4d5c4ac96b8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:59.174200 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-24a7cf79-025b-4966-8836-4d5c4ac96b8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:59.206173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-24a7cf79-025b-4966-8836-4d5c4ac96b8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050082 Aug 30 01:04:59.206802 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 228/467] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:04:59 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:59.691565 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-baed9c4b-d7e0-47fa-83da-dd6d6a13a8c4 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:59.697788 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-baed9c4b-d7e0-47fa-83da-dd6d6a13a8c4 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:59.698271 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-baed9c4b-d7e0-47fa-83da-dd6d6a13a8c4 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:59.698710 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-baed9c4b-d7e0-47fa-83da-dd6d6a13a8c4 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:59.721106 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-baed9c4b-d7e0-47fa-83da-dd6d6a13a8c4 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Going to try to stop instance {{(pid=120630) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 01:04:59.760843 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-baed9c4b-d7e0-47fa-83da-dd6d6a13a8c4 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "POST /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2/action" status: 202 len: 0 microversion: 2.1 time: 0.073792 Aug 30 01:04:59.761506 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 240/468] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 30 01:04:59 2022] POST /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:04:59.770154 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-c96fde8c-fdad-4fe4-8591-687417f7a03a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:59.770995 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-c96fde8c-fdad-4fe4-8591-687417f7a03a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:59.776955 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c96fde8c-fdad-4fe4-8591-687417f7a03a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:59.777483 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c96fde8c-fdad-4fe4-8591-687417f7a03a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:59.777984 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c96fde8c-fdad-4fe4-8591-687417f7a03a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:59.778682 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c96fde8c-fdad-4fe4-8591-687417f7a03a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:59.779138 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c96fde8c-fdad-4fe4-8591-687417f7a03a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:59.779562 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c96fde8c-fdad-4fe4-8591-687417f7a03a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:59.910671 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-c96fde8c-fdad-4fe4-8591-687417f7a03a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:59.919137 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-c96fde8c-fdad-4fe4-8591-687417f7a03a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1719 microversion: 2.1 time: 0.152796 Aug 30 01:04:59.919698 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 229/469] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:59 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:00.218639 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-3daf28ae-0cbd-4ec4-87b5-7e69740a92e7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:00.221096 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-3daf28ae-0cbd-4ec4-87b5-7e69740a92e7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:00.227181 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3daf28ae-0cbd-4ec4-87b5-7e69740a92e7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:00.227664 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3daf28ae-0cbd-4ec4-87b5-7e69740a92e7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:00.228098 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3daf28ae-0cbd-4ec4-87b5-7e69740a92e7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:00.228779 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3daf28ae-0cbd-4ec4-87b5-7e69740a92e7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:00.229265 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3daf28ae-0cbd-4ec4-87b5-7e69740a92e7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:00.229686 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3daf28ae-0cbd-4ec4-87b5-7e69740a92e7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:00.260571 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-3daf28ae-0cbd-4ec4-87b5-7e69740a92e7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046000 Aug 30 01:05:00.260941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 241/470] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:05:00 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:05:00.939827 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-6963bf46-c160-4279-843e-ffb99862a41f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:00.940444 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-6963bf46-c160-4279-843e-ffb99862a41f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:00.946903 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6963bf46-c160-4279-843e-ffb99862a41f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:00.947382 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6963bf46-c160-4279-843e-ffb99862a41f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:00.947818 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6963bf46-c160-4279-843e-ffb99862a41f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:00.948507 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6963bf46-c160-4279-843e-ffb99862a41f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:00.948961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6963bf46-c160-4279-843e-ffb99862a41f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:00.949959 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6963bf46-c160-4279-843e-ffb99862a41f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:01.079141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6963bf46-c160-4279-843e-ffb99862a41f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:01.086797 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-6963bf46-c160-4279-843e-ffb99862a41f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1673 microversion: 2.1 time: 0.150865 Aug 30 01:05:01.087354 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 230/471] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:00 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:01.272138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-6f5df3f2-a8f5-4359-b700-552f4cb6cea5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:01.274376 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-6f5df3f2-a8f5-4359-b700-552f4cb6cea5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:01.280786 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6f5df3f2-a8f5-4359-b700-552f4cb6cea5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:01.281293 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6f5df3f2-a8f5-4359-b700-552f4cb6cea5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:01.281733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6f5df3f2-a8f5-4359-b700-552f4cb6cea5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:01.282500 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6f5df3f2-a8f5-4359-b700-552f4cb6cea5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:01.282960 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6f5df3f2-a8f5-4359-b700-552f4cb6cea5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:01.283386 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6f5df3f2-a8f5-4359-b700-552f4cb6cea5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:01.312444 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-6f5df3f2-a8f5-4359-b700-552f4cb6cea5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044441 Aug 30 01:05:01.312998 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 242/472] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:05:01 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:05:01.373659 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-dc76766a-87d9-488c-85ce-5054612d0c59 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:01.374151 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-dc76766a-87d9-488c-85ce-5054612d0c59 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:01.379995 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dc76766a-87d9-488c-85ce-5054612d0c59 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:01.380469 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dc76766a-87d9-488c-85ce-5054612d0c59 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:01.380894 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dc76766a-87d9-488c-85ce-5054612d0c59 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:01.381597 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dc76766a-87d9-488c-85ce-5054612d0c59 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:01.382075 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dc76766a-87d9-488c-85ce-5054612d0c59 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:01.382490 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dc76766a-87d9-488c-85ce-5054612d0c59 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:01.410421 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-dc76766a-87d9-488c-85ce-5054612d0c59 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Going to try to terminate instance {{(pid=120631) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:05:01.487784 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-dc76766a-87d9-488c-85ce-5054612d0c59 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 204 len: 0 microversion: 2.1 time: 0.117614 Aug 30 01:05:01.488374 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 231/473] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:05:01 2022] DELETE /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:05:01.496783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-744ab0e7-c821-4bea-86cf-cbdeb90990fa tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:01.497507 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-744ab0e7-c821-4bea-86cf-cbdeb90990fa tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:01.503476 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-744ab0e7-c821-4bea-86cf-cbdeb90990fa tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:01.503966 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-744ab0e7-c821-4bea-86cf-cbdeb90990fa tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:01.504410 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-744ab0e7-c821-4bea-86cf-cbdeb90990fa tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:01.505129 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-744ab0e7-c821-4bea-86cf-cbdeb90990fa tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:01.505587 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-744ab0e7-c821-4bea-86cf-cbdeb90990fa tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:01.506015 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-744ab0e7-c821-4bea-86cf-cbdeb90990fa tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:01.638516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-744ab0e7-c821-4bea-86cf-cbdeb90990fa tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:01.646286 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-744ab0e7-c821-4bea-86cf-cbdeb90990fa tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1679 microversion: 2.1 time: 0.153625 Aug 30 01:05:01.646850 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 243/474] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:01 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:02.109360 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-582691f0-aa9e-47c4-a1a7-bbab0ff8f7e0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:02.110056 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-582691f0-aa9e-47c4-a1a7-bbab0ff8f7e0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:02.116385 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-582691f0-aa9e-47c4-a1a7-bbab0ff8f7e0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:02.116870 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-582691f0-aa9e-47c4-a1a7-bbab0ff8f7e0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:02.117340 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-582691f0-aa9e-47c4-a1a7-bbab0ff8f7e0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:02.118031 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-582691f0-aa9e-47c4-a1a7-bbab0ff8f7e0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:02.118485 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-582691f0-aa9e-47c4-a1a7-bbab0ff8f7e0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:02.118913 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-582691f0-aa9e-47c4-a1a7-bbab0ff8f7e0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:02.251188 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-582691f0-aa9e-47c4-a1a7-bbab0ff8f7e0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:02.258935 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-582691f0-aa9e-47c4-a1a7-bbab0ff8f7e0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1673 microversion: 2.1 time: 0.153858 Aug 30 01:05:02.259531 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 232/475] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:02 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:02.668013 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-189f3c37-ec21-44d9-9aec-56a049676b35 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:02.668792 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-189f3c37-ec21-44d9-9aec-56a049676b35 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:02.675201 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-189f3c37-ec21-44d9-9aec-56a049676b35 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:02.675681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-189f3c37-ec21-44d9-9aec-56a049676b35 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:02.676117 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-189f3c37-ec21-44d9-9aec-56a049676b35 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:02.676834 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-189f3c37-ec21-44d9-9aec-56a049676b35 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:02.677318 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-189f3c37-ec21-44d9-9aec-56a049676b35 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:02.677739 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-189f3c37-ec21-44d9-9aec-56a049676b35 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:02.809127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-189f3c37-ec21-44d9-9aec-56a049676b35 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:02.816795 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-189f3c37-ec21-44d9-9aec-56a049676b35 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1679 microversion: 2.1 time: 0.152679 Aug 30 01:05:02.817422 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 244/476] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:02 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:03.280507 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-f78d7279-0774-4935-bab2-1e16cc358105 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:03.281148 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-f78d7279-0774-4935-bab2-1e16cc358105 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:03.287619 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f78d7279-0774-4935-bab2-1e16cc358105 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:03.288101 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f78d7279-0774-4935-bab2-1e16cc358105 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:03.288794 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f78d7279-0774-4935-bab2-1e16cc358105 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:03.289588 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f78d7279-0774-4935-bab2-1e16cc358105 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:03.290048 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f78d7279-0774-4935-bab2-1e16cc358105 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:03.290477 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f78d7279-0774-4935-bab2-1e16cc358105 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:03.425487 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-f78d7279-0774-4935-bab2-1e16cc358105 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:03.433097 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-f78d7279-0774-4935-bab2-1e16cc358105 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1673 microversion: 2.1 time: 0.157197 Aug 30 01:05:03.434157 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 233/477] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:03 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:05:03.838007 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-7acff586-07e0-4d39-b728-c68bffa54fa7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:03.838619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-7acff586-07e0-4d39-b728-c68bffa54fa7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:03.845341 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7acff586-07e0-4d39-b728-c68bffa54fa7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:03.845830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7acff586-07e0-4d39-b728-c68bffa54fa7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:03.846269 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7acff586-07e0-4d39-b728-c68bffa54fa7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:03.846971 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7acff586-07e0-4d39-b728-c68bffa54fa7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:03.847423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7acff586-07e0-4d39-b728-c68bffa54fa7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:03.847844 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7acff586-07e0-4d39-b728-c68bffa54fa7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:03.977414 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7acff586-07e0-4d39-b728-c68bffa54fa7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:03.985676 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-7acff586-07e0-4d39-b728-c68bffa54fa7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1679 microversion: 2.1 time: 0.151468 Aug 30 01:05:03.986239 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 245/478] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:03 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:04.453820 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-61360088-358d-41a1-b7f8-24eaa54f9b03 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:04.454466 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-61360088-358d-41a1-b7f8-24eaa54f9b03 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:04.460642 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-61360088-358d-41a1-b7f8-24eaa54f9b03 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:04.461154 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-61360088-358d-41a1-b7f8-24eaa54f9b03 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:04.461594 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-61360088-358d-41a1-b7f8-24eaa54f9b03 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:04.462288 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-61360088-358d-41a1-b7f8-24eaa54f9b03 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:04.462745 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-61360088-358d-41a1-b7f8-24eaa54f9b03 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:04.463167 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-61360088-358d-41a1-b7f8-24eaa54f9b03 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:04.598028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-037dc6f4-7f3d-4a8b-a84b-98afc6d2e787 req-d67b56fa-b27d-463a-8ef7-74baa2d34189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d2ed1b9-2567-4964-83fd-dd44533766ae", "name": "network-vif-deleted", "tag": "d7e5e765-e1c7-48ec-8dcf-1d5e6de0b12b"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:05:04.602090 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-61360088-358d-41a1-b7f8-24eaa54f9b03 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:04.608097 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-037dc6f4-7f3d-4a8b-a84b-98afc6d2e787 req-d67b56fa-b27d-463a-8ef7-74baa2d34189 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:04.608538 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-037dc6f4-7f3d-4a8b-a84b-98afc6d2e787 req-d67b56fa-b27d-463a-8ef7-74baa2d34189 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:04.609216 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-037dc6f4-7f3d-4a8b-a84b-98afc6d2e787 req-d67b56fa-b27d-463a-8ef7-74baa2d34189 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:04.611689 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-61360088-358d-41a1-b7f8-24eaa54f9b03 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1673 microversion: 2.1 time: 0.161601 Aug 30 01:05:04.612274 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 234/479] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:04 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:04.620882 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-037dc6f4-7f3d-4a8b-a84b-98afc6d2e787 req-d67b56fa-b27d-463a-8ef7-74baa2d34189 service nova] Creating event network-vif-deleted:d7e5e765-e1c7-48ec-8dcf-1d5e6de0b12b for instance 8d2ed1b9-2567-4964-83fd-dd44533766ae on hv-cinder-81514 Aug 30 01:05:04.627586 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-037dc6f4-7f3d-4a8b-a84b-98afc6d2e787 req-d67b56fa-b27d-463a-8ef7-74baa2d34189 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033198 Aug 30 01:05:04.628293 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 246/480] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:05:05.007546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-449ffc30-2fdc-41a1-80e7-4503f0c55e8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:05.008157 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-449ffc30-2fdc-41a1-80e7-4503f0c55e8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:05.014064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-449ffc30-2fdc-41a1-80e7-4503f0c55e8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:05.014549 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-449ffc30-2fdc-41a1-80e7-4503f0c55e8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:05.014978 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-449ffc30-2fdc-41a1-80e7-4503f0c55e8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:05.015665 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-449ffc30-2fdc-41a1-80e7-4503f0c55e8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:05.016116 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-449ffc30-2fdc-41a1-80e7-4503f0c55e8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:05.016538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-449ffc30-2fdc-41a1-80e7-4503f0c55e8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:05.048808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-449ffc30-2fdc-41a1-80e7-4503f0c55e8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:05.049309 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-449ffc30-2fdc-41a1-80e7-4503f0c55e8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:05.049741 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-449ffc30-2fdc-41a1-80e7-4503f0c55e8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:05.050182 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.objects.instance [None req-449ffc30-2fdc-41a1-80e7-4503f0c55e8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lazy-loading 'fault' on Instance uuid 8d2ed1b9-2567-4964-83fd-dd44533766ae {{(pid=120631) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:05:05.089469 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-449ffc30-2fdc-41a1-80e7-4503f0c55e8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:05.093634 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:05.098262 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-449ffc30-2fdc-41a1-80e7-4503f0c55e8b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 200 len: 1330 microversion: 2.1 time: 0.094550 Aug 30 01:05:05.098839 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 235/481] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:05 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 1330 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:05.632814 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8700cbc4-7a2e-47b8-b9a5-e8e38ded7bb8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:05.633552 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8700cbc4-7a2e-47b8-b9a5-e8e38ded7bb8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:05.640045 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8700cbc4-7a2e-47b8-b9a5-e8e38ded7bb8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:05.640531 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8700cbc4-7a2e-47b8-b9a5-e8e38ded7bb8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:05.640973 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8700cbc4-7a2e-47b8-b9a5-e8e38ded7bb8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:05.641702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8700cbc4-7a2e-47b8-b9a5-e8e38ded7bb8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:05.642157 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8700cbc4-7a2e-47b8-b9a5-e8e38ded7bb8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:05.642583 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8700cbc4-7a2e-47b8-b9a5-e8e38ded7bb8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:05.772099 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8700cbc4-7a2e-47b8-b9a5-e8e38ded7bb8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:05.780918 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8700cbc4-7a2e-47b8-b9a5-e8e38ded7bb8 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1673 microversion: 2.1 time: 0.152896 Aug 30 01:05:05.781516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 247/482] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:05 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:06.119931 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-ec2d1a44-4f71-4804-8c8d-6f924f34f4d7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:06.120462 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-ec2d1a44-4f71-4804-8c8d-6f924f34f4d7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:06.127991 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ec2d1a44-4f71-4804-8c8d-6f924f34f4d7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:06.128470 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ec2d1a44-4f71-4804-8c8d-6f924f34f4d7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:06.128900 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ec2d1a44-4f71-4804-8c8d-6f924f34f4d7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:06.129623 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ec2d1a44-4f71-4804-8c8d-6f924f34f4d7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:06.130085 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ec2d1a44-4f71-4804-8c8d-6f924f34f4d7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:06.130499 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ec2d1a44-4f71-4804-8c8d-6f924f34f4d7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:06.145159 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-ec2d1a44-4f71-4804-8c8d-6f924f34f4d7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] HTTP exception thrown: Instance 8d2ed1b9-2567-4964-83fd-dd44533766ae could not be found. Aug 30 01:05:06.146803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-ec2d1a44-4f71-4804-8c8d-6f924f34f4d7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Request method failure captured: Aug 30 01:05:06.146803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae HTTP/1.1 Aug 30 01:05:06.146803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:05:06.146803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:05:06.146803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:05:06.146803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:05:06.146803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:05:06.146803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:05:06.146803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:05:06.146803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:05:06.146803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWFfZmUwgQ0mFuieojBsvktSnruxexkMD8R8bd6MnZKGHmPnXPTUGPvemFUgtcXUu8u-yzCNpJULMfiAasm8f-KjX-nH3CChWEIyCAavljtkV9ICnALTHbbll4hz4f_VNsMQOGGKv1XAa5uQHI8I8bGS718FQfoeBt-22Hj_CVvvdxo Aug 30 01:05:06.146803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:05:06.146803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:05:06.146803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:05:06.146803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:05:06.146803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:05:06.146803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:05:06.146803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:05:06.146803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:05:06.146803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:05:06.146803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:05:06.148285 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0596692dbfb149139a1e72159c6f93db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}] Aug 30 01:05:06.148285 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:05:06.148285 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:05:06.148285 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:05:06.148285 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:05:06.148285 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:05:06.148285 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:05:06.148285 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: cc7cf306aadb45d1b65252b53c86b612 Aug 30 01:05:06.148285 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:05:06.148285 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:05:06.148285 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Instance 8d2ed1b9-2567-4964-83fd-dd44533766ae could not be found. Aug 30 01:05:06.148285 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': '8d2ed1b9-2567-4964-83fd-dd44533766ae'} Aug 30 01:05:06.149144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:05:06.149144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:05:06.149144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:05:06.149144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:05:06.149144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:05:06.149144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:05:06.149144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:05:06.149144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:05:06.149144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:05:06.149144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:05:06.149144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d2ed1b9-2567-4964-83fd-dd44533766ae could not be found. Aug 30 01:05:06.149144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:05:06.149144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:05:06.149144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:05:06.149144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:05:06.149144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:05:06.149144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:05:06.149144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:05:06.149144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:05:06.149144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:05:06.150516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:05:06.150516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:05:06.150516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:05:06.150516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:05:06.150516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:05:06.150516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:05:06.150516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:05:06.150516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d2ed1b9-2567-4964-83fd-dd44533766ae could not be found. Aug 30 01:05:06.150516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:05:06.150516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:05:06.150516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:05:06.150516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:05:06.150516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:05:06.150516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:05:06.150516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:05:06.150516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:05:06.150516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d2ed1b9-2567-4964-83fd-dd44533766ae could not be found. Aug 30 01:05:06.150516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:05:06.151752 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-ec2d1a44-4f71-4804-8c8d-6f924f34f4d7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Returning 404 to user: Instance 8d2ed1b9-2567-4964-83fd-dd44533766ae could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:05:06.151752 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-ec2d1a44-4f71-4804-8c8d-6f924f34f4d7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 404 len: 111 microversion: 2.1 time: 0.032208 Aug 30 01:05:06.151752 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 236/483] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:06 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:05:06.158409 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-5f5512e0-38c4-47fb-887b-777f29cb2170 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '.version_select at 0x7f0f52840280>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:06.178279 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-5f5512e0-38c4-47fb-887b-777f29cb2170 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-192310298" status: 202 len: 0 microversion: 2.1 time: 0.023679 Aug 30 01:05:06.178827 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 248/484] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Aug 30 01:05:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-192310298 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:05:06.785814 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0c80c6e3-01f0-4f03-ac91-d4cf2ea003b4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Action: 'create', calling method: .version_select at 0x7f0f5281fa60>, body: {"keypair": {"name": "tempest-keypair-1469346838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9BNSjluFo410rplfRbnsRi1IO6aHyAdIwmAWk+JnGafGDc0afuWATbu9VtlQh9otqSxgkdI+J0UeuOFPZUsSQWnfoUNcBgj9YYd75q91n/yIGzYsKFt/XMFlIm675tQg=="}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:05:06.802657 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-0c80c6e3-01f0-4f03-ac91-d4cf2ea003b4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Getting quotas for project 0596692dbfb149139a1e72159c6f93db. Resources: {'key_pairs'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:05:06.803706 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8f7d658c-a4fc-4213-b4f3-f0ccfd52d78e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:06.804312 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8f7d658c-a4fc-4213-b4f3-f0ccfd52d78e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:06.806838 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-0c80c6e3-01f0-4f03-ac91-d4cf2ea003b4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Getting quotas for user cc7cf306aadb45d1b65252b53c86b612 and project 0596692dbfb149139a1e72159c6f93db. Resources: {'key_pairs'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:05:06.811312 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8f7d658c-a4fc-4213-b4f3-f0ccfd52d78e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:06.811935 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8f7d658c-a4fc-4213-b4f3-f0ccfd52d78e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:06.812381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8f7d658c-a4fc-4213-b4f3-f0ccfd52d78e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:06.813174 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8f7d658c-a4fc-4213-b4f3-f0ccfd52d78e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:06.813719 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8f7d658c-a4fc-4213-b4f3-f0ccfd52d78e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:06.814522 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8f7d658c-a4fc-4213-b4f3-f0ccfd52d78e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:06.832539 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0c80c6e3-01f0-4f03-ac91-d4cf2ea003b4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053273 Aug 30 01:05:06.833595 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 237/485] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 30 01:05:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:05:07.004828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8f7d658c-a4fc-4213-b4f3-f0ccfd52d78e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:07.016718 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8f7d658c-a4fc-4213-b4f3-f0ccfd52d78e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1673 microversion: 2.1 time: 0.217527 Aug 30 01:05:07.017324 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 249/486] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:06 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1673 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:05:08.040152 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-604ca2f7-98a5-4ec9-9217-07cfe14cdfd6 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:08.040858 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-604ca2f7-98a5-4ec9-9217-07cfe14cdfd6 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:08.047676 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-604ca2f7-98a5-4ec9-9217-07cfe14cdfd6 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:08.048243 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-604ca2f7-98a5-4ec9-9217-07cfe14cdfd6 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:08.048676 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-604ca2f7-98a5-4ec9-9217-07cfe14cdfd6 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:08.049387 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-604ca2f7-98a5-4ec9-9217-07cfe14cdfd6 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:08.049840 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-604ca2f7-98a5-4ec9-9217-07cfe14cdfd6 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:08.050259 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-604ca2f7-98a5-4ec9-9217-07cfe14cdfd6 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:08.198503 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-604ca2f7-98a5-4ec9-9217-07cfe14cdfd6 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:08.207150 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-604ca2f7-98a5-4ec9-9217-07cfe14cdfd6 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1673 microversion: 2.1 time: 0.171512 Aug 30 01:05:08.221103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 238/487] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:08 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:08.426939 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-d1aed8a7-b825-47fc-b0bd-5ee3c4950d11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-649086837", "imageRef": "d6c817b5-c41c-4210-a963-172386e2e582", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dffca817-1d31-4c9c-99a3-2d8483c143b4"}], "security_groups": [{"name": "tempest-securitygroup--2100703437"}], "key_name": "tempest-keypair-1469346838", "user_data": "}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:05:08.528671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.network.neutron [None req-d1aed8a7-b825-47fc-b0bd-5ee3c4950d11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] validate_networks() for [('dffca817-1d31-4c9c-99a3-2d8483c143b4', None, None, None, None, None)] {{(pid=120630) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:05:08.891806 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-d1aed8a7-b825-47fc-b0bd-5ee3c4950d11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Flavor limits 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:05:08.892282 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-d1aed8a7-b825-47fc-b0bd-5ee3c4950d11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Image limits 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:05:08.892758 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-d1aed8a7-b825-47fc-b0bd-5ee3c4950d11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Flavor pref 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:05:08.893196 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-d1aed8a7-b825-47fc-b0bd-5ee3c4950d11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Image pref 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:05:08.893633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-d1aed8a7-b825-47fc-b0bd-5ee3c4950d11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:05:08.903084 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d1aed8a7-b825-47fc-b0bd-5ee3c4950d11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:08.903573 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d1aed8a7-b825-47fc-b0bd-5ee3c4950d11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:08.904010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d1aed8a7-b825-47fc-b0bd-5ee3c4950d11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:08.904739 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d1aed8a7-b825-47fc-b0bd-5ee3c4950d11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:08.905218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d1aed8a7-b825-47fc-b0bd-5ee3c4950d11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:08.905644 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d1aed8a7-b825-47fc-b0bd-5ee3c4950d11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:08.912369 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:08.926919 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-d1aed8a7-b825-47fc-b0bd-5ee3c4950d11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Getting quotas for project 0596692dbfb149139a1e72159c6f93db. Resources: {'ram', 'instances', 'cores'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:05:08.930954 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-d1aed8a7-b825-47fc-b0bd-5ee3c4950d11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Getting quotas for user cc7cf306aadb45d1b65252b53c86b612 and project 0596692dbfb149139a1e72159c6f93db. Resources: {'ram', 'instances', 'cores'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:05:08.943597 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-d1aed8a7-b825-47fc-b0bd-5ee3c4950d11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Going to run 1 instances... {{(pid=120630) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:05:08.945982 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-d1aed8a7-b825-47fc-b0bd-5ee3c4950d11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6c817b5-c41c-4210-a963-172386e2e582',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:05:08.994414 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-d1aed8a7-b825-47fc-b0bd-5ee3c4950d11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.571648 Aug 30 01:05:08.995150 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 250/488] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 30 01:05:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:05:09.006426 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-a35ee2cf-3252-4b0a-8897-17cdbf187de5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:09.007198 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-a35ee2cf-3252-4b0a-8897-17cdbf187de5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:09.061834 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-a35ee2cf-3252-4b0a-8897-17cdbf187de5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:09.068829 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-a35ee2cf-3252-4b0a-8897-17cdbf187de5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325" status: 200 len: 1241 microversion: 2.1 time: 0.066327 Aug 30 01:05:09.069419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 239/489] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:09 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:09.229726 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-07015cf0-d537-46cd-bf20-02ddc91100df tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:09.230854 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-07015cf0-d537-46cd-bf20-02ddc91100df tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:09.237444 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-07015cf0-d537-46cd-bf20-02ddc91100df tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:09.237934 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-07015cf0-d537-46cd-bf20-02ddc91100df tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:09.238381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-07015cf0-d537-46cd-bf20-02ddc91100df tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:09.239113 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-07015cf0-d537-46cd-bf20-02ddc91100df tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:09.239708 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-07015cf0-d537-46cd-bf20-02ddc91100df tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:09.240138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-07015cf0-d537-46cd-bf20-02ddc91100df tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:09.384079 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-07015cf0-d537-46cd-bf20-02ddc91100df tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:09.391988 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-07015cf0-d537-46cd-bf20-02ddc91100df tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1673 microversion: 2.1 time: 0.166265 Aug 30 01:05:09.392537 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 251/490] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:09 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:10.091271 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e977c7b9-5021-4c92-b84f-89189a885e61 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:10.091838 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e977c7b9-5021-4c92-b84f-89189a885e61 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:10.099058 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e977c7b9-5021-4c92-b84f-89189a885e61 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:10.099543 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e977c7b9-5021-4c92-b84f-89189a885e61 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:10.099984 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e977c7b9-5021-4c92-b84f-89189a885e61 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:10.100673 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e977c7b9-5021-4c92-b84f-89189a885e61 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:10.101156 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e977c7b9-5021-4c92-b84f-89189a885e61 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:10.101582 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e977c7b9-5021-4c92-b84f-89189a885e61 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:10.168420 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e977c7b9-5021-4c92-b84f-89189a885e61 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:10.176086 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e977c7b9-5021-4c92-b84f-89189a885e61 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325" status: 200 len: 1293 microversion: 2.1 time: 0.089752 Aug 30 01:05:10.176640 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 240/491] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:10 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:10.416118 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4c0f3be7-c654-4a33-b259-80bf6263c0c3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:10.419227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-4c0f3be7-c654-4a33-b259-80bf6263c0c3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:10.429402 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c0f3be7-c654-4a33-b259-80bf6263c0c3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:10.430007 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c0f3be7-c654-4a33-b259-80bf6263c0c3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:10.430561 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c0f3be7-c654-4a33-b259-80bf6263c0c3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:10.431706 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c0f3be7-c654-4a33-b259-80bf6263c0c3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:10.432160 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c0f3be7-c654-4a33-b259-80bf6263c0c3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:10.432769 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c0f3be7-c654-4a33-b259-80bf6263c0c3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:10.584235 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-4c0f3be7-c654-4a33-b259-80bf6263c0c3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:10.595876 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-4c0f3be7-c654-4a33-b259-80bf6263c0c3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1650 microversion: 2.1 time: 0.187037 Aug 30 01:05:10.606979 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 252/492] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:10 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1650 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:10.622354 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-33c72760-050d-4462-9d13-f73fc89fba3f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:05:10.628825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-33c72760-050d-4462-9d13-f73fc89fba3f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:10.629350 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-33c72760-050d-4462-9d13-f73fc89fba3f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:10.629835 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-33c72760-050d-4462-9d13-f73fc89fba3f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:10.691628 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-33c72760-050d-4462-9d13-f73fc89fba3f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Going to try to start instance {{(pid=120631) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 01:05:10.737584 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-33c72760-050d-4462-9d13-f73fc89fba3f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "POST /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2/action" status: 202 len: 0 microversion: 2.1 time: 0.124071 Aug 30 01:05:10.738286 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 241/493] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 30 01:05:10 2022] POST /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:05:10.748791 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f4ebe72c-2ce2-4fda-a41f-2ab0ccab8868 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:10.749594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-f4ebe72c-2ce2-4fda-a41f-2ab0ccab8868 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:10.755888 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f4ebe72c-2ce2-4fda-a41f-2ab0ccab8868 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:10.756603 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f4ebe72c-2ce2-4fda-a41f-2ab0ccab8868 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:10.757509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f4ebe72c-2ce2-4fda-a41f-2ab0ccab8868 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:10.758915 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f4ebe72c-2ce2-4fda-a41f-2ab0ccab8868 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:10.759418 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f4ebe72c-2ce2-4fda-a41f-2ab0ccab8868 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:10.760130 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f4ebe72c-2ce2-4fda-a41f-2ab0ccab8868 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:10.945145 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-f4ebe72c-2ce2-4fda-a41f-2ab0ccab8868 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:10.953690 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-f4ebe72c-2ce2-4fda-a41f-2ab0ccab8868 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1659 microversion: 2.1 time: 0.210673 Aug 30 01:05:10.960006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 253/494] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:10 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1659 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:11.200684 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3f640458-b44b-4f56-8ae1-fd2b94d9450d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:11.202353 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-3f640458-b44b-4f56-8ae1-fd2b94d9450d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:11.210255 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3f640458-b44b-4f56-8ae1-fd2b94d9450d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:11.211079 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3f640458-b44b-4f56-8ae1-fd2b94d9450d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:11.211524 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3f640458-b44b-4f56-8ae1-fd2b94d9450d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:11.212241 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3f640458-b44b-4f56-8ae1-fd2b94d9450d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:11.212695 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3f640458-b44b-4f56-8ae1-fd2b94d9450d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:11.213587 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3f640458-b44b-4f56-8ae1-fd2b94d9450d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:11.425670 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-418a1518-bce3-48d1-b5ec-fec5b49b1bc2 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:05:11.428375 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-418a1518-bce3-48d1-b5ec-fec5b49b1bc2 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:11.441146 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-418a1518-bce3-48d1-b5ec-fec5b49b1bc2 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:11.444860 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-418a1518-bce3-48d1-b5ec-fec5b49b1bc2 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:11.445412 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-418a1518-bce3-48d1-b5ec-fec5b49b1bc2 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:11.446270 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-418a1518-bce3-48d1-b5ec-fec5b49b1bc2 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:11.446747 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-418a1518-bce3-48d1-b5ec-fec5b49b1bc2 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:11.447251 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-418a1518-bce3-48d1-b5ec-fec5b49b1bc2 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:11.459539 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3f640458-b44b-4f56-8ae1-fd2b94d9450d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:11.471083 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3f640458-b44b-4f56-8ae1-fd2b94d9450d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325" status: 200 len: 1367 microversion: 2.1 time: 0.275589 Aug 30 01:05:11.472843 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 242/495] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:11 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:11.553320 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-418a1518-bce3-48d1-b5ec-fec5b49b1bc2 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "POST /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371/action" status: 202 len: 0 microversion: 2.1 time: 0.132101 Aug 30 01:05:11.557127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 254/496] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 30 01:05:11 2022] POST /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:05:11.567525 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-9694706f-0a73-4f5d-b5f5-22ca9a6cb164 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:11.570168 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-9694706f-0a73-4f5d-b5f5-22ca9a6cb164 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:11.580208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9694706f-0a73-4f5d-b5f5-22ca9a6cb164 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:11.581286 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9694706f-0a73-4f5d-b5f5-22ca9a6cb164 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:11.581892 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9694706f-0a73-4f5d-b5f5-22ca9a6cb164 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:11.583736 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9694706f-0a73-4f5d-b5f5-22ca9a6cb164 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:11.584196 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9694706f-0a73-4f5d-b5f5-22ca9a6cb164 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:11.584781 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9694706f-0a73-4f5d-b5f5-22ca9a6cb164 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:11.786540 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-9694706f-0a73-4f5d-b5f5-22ca9a6cb164 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:11.797864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-9694706f-0a73-4f5d-b5f5-22ca9a6cb164 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1752 microversion: 2.1 time: 0.237410 Aug 30 01:05:11.799318 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 243/497] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:11 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1752 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:11.835406 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-ccc7c0e9-9b1a-46fc-9efd-23771b4ea415 req-1c1238af-7a2f-421d-9109-d462d2d86abc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4af1febc-f5f3-440d-ab4b-0e33ac174325", "tag": "b0dd4618-5f7f-4366-b8dd-3fb92df6a2c1"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:05:11.847084 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-ccc7c0e9-9b1a-46fc-9efd-23771b4ea415 req-1c1238af-7a2f-421d-9109-d462d2d86abc service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:11.847704 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-ccc7c0e9-9b1a-46fc-9efd-23771b4ea415 req-1c1238af-7a2f-421d-9109-d462d2d86abc service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:11.848172 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-ccc7c0e9-9b1a-46fc-9efd-23771b4ea415 req-1c1238af-7a2f-421d-9109-d462d2d86abc service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:11.860717 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-ccc7c0e9-9b1a-46fc-9efd-23771b4ea415 req-1c1238af-7a2f-421d-9109-d462d2d86abc service nova] Creating event network-changed:b0dd4618-5f7f-4366-b8dd-3fb92df6a2c1 for instance 4af1febc-f5f3-440d-ab4b-0e33ac174325 on hv-cinder-81514 Aug 30 01:05:11.865791 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-ccc7c0e9-9b1a-46fc-9efd-23771b4ea415 req-1c1238af-7a2f-421d-9109-d462d2d86abc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035447 Aug 30 01:05:11.866697 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 255/498] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:05:11.974630 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-6ad66a09-2a53-4869-9549-1c548e33cdb2 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:11.975565 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-6ad66a09-2a53-4869-9549-1c548e33cdb2 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:11.981827 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ad66a09-2a53-4869-9549-1c548e33cdb2 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:11.982327 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ad66a09-2a53-4869-9549-1c548e33cdb2 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:11.982751 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ad66a09-2a53-4869-9549-1c548e33cdb2 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:11.983446 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ad66a09-2a53-4869-9549-1c548e33cdb2 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:11.983898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ad66a09-2a53-4869-9549-1c548e33cdb2 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:11.984385 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6ad66a09-2a53-4869-9549-1c548e33cdb2 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:12.115710 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6ad66a09-2a53-4869-9549-1c548e33cdb2 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:12.124607 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-6ad66a09-2a53-4869-9549-1c548e33cdb2 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1659 microversion: 2.1 time: 0.153590 Aug 30 01:05:12.125348 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 244/499] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:11 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1659 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:12.494093 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-ae1543fa-1ac8-4033-b956-c65abb0511f9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:12.494803 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-ae1543fa-1ac8-4033-b956-c65abb0511f9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:12.501327 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ae1543fa-1ac8-4033-b956-c65abb0511f9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:12.501811 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ae1543fa-1ac8-4033-b956-c65abb0511f9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:12.502254 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ae1543fa-1ac8-4033-b956-c65abb0511f9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:12.502942 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ae1543fa-1ac8-4033-b956-c65abb0511f9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:12.503393 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ae1543fa-1ac8-4033-b956-c65abb0511f9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:12.503815 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ae1543fa-1ac8-4033-b956-c65abb0511f9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:12.639974 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-ae1543fa-1ac8-4033-b956-c65abb0511f9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:12.647482 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-ae1543fa-1ac8-4033-b956-c65abb0511f9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325" status: 200 len: 1367 microversion: 2.1 time: 0.158974 Aug 30 01:05:12.648041 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 256/500] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:12 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:12.820243 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-b97180a6-c2e7-441a-88aa-d1d20b6f400c tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:12.820934 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-b97180a6-c2e7-441a-88aa-d1d20b6f400c tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:12.829339 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b97180a6-c2e7-441a-88aa-d1d20b6f400c tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:12.830041 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b97180a6-c2e7-441a-88aa-d1d20b6f400c tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:12.830857 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b97180a6-c2e7-441a-88aa-d1d20b6f400c tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:12.831601 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b97180a6-c2e7-441a-88aa-d1d20b6f400c tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:12.832060 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b97180a6-c2e7-441a-88aa-d1d20b6f400c tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:12.832514 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b97180a6-c2e7-441a-88aa-d1d20b6f400c tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:13.007069 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-b97180a6-c2e7-441a-88aa-d1d20b6f400c tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:13.016026 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-b97180a6-c2e7-441a-88aa-d1d20b6f400c tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1752 microversion: 2.1 time: 0.200193 Aug 30 01:05:13.016588 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 245/501] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:12 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1752 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:13.156177 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-52ad6d16-862a-4a54-b96a-8fae4f5dca15 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:13.156778 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-52ad6d16-862a-4a54-b96a-8fae4f5dca15 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:13.162673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-52ad6d16-862a-4a54-b96a-8fae4f5dca15 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:13.163402 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-52ad6d16-862a-4a54-b96a-8fae4f5dca15 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:13.163829 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-52ad6d16-862a-4a54-b96a-8fae4f5dca15 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:13.164506 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-52ad6d16-862a-4a54-b96a-8fae4f5dca15 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:13.164958 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-52ad6d16-862a-4a54-b96a-8fae4f5dca15 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:13.165398 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-52ad6d16-862a-4a54-b96a-8fae4f5dca15 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:13.295203 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-52ad6d16-862a-4a54-b96a-8fae4f5dca15 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:13.303029 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-52ad6d16-862a-4a54-b96a-8fae4f5dca15 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1663 microversion: 2.1 time: 0.151288 Aug 30 01:05:13.303593 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 257/502] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:13 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:13.669793 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3ba59351-e52f-4e6c-826c-8ff9cb8caad2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:13.670405 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-3ba59351-e52f-4e6c-826c-8ff9cb8caad2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:13.676390 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3ba59351-e52f-4e6c-826c-8ff9cb8caad2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:13.676874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3ba59351-e52f-4e6c-826c-8ff9cb8caad2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:13.677352 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3ba59351-e52f-4e6c-826c-8ff9cb8caad2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:13.678041 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3ba59351-e52f-4e6c-826c-8ff9cb8caad2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:13.678493 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3ba59351-e52f-4e6c-826c-8ff9cb8caad2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:13.678913 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3ba59351-e52f-4e6c-826c-8ff9cb8caad2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:13.811256 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3ba59351-e52f-4e6c-826c-8ff9cb8caad2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:13.819237 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3ba59351-e52f-4e6c-826c-8ff9cb8caad2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325" status: 200 len: 1367 microversion: 2.1 time: 0.154235 Aug 30 01:05:13.819819 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 246/503] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:13 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:14.039177 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-c7ef797b-2ea8-411b-9009-25b8808afa4d tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:14.039722 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-c7ef797b-2ea8-411b-9009-25b8808afa4d tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:14.046438 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c7ef797b-2ea8-411b-9009-25b8808afa4d tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:14.046977 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c7ef797b-2ea8-411b-9009-25b8808afa4d tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:14.047416 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c7ef797b-2ea8-411b-9009-25b8808afa4d tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:14.048110 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c7ef797b-2ea8-411b-9009-25b8808afa4d tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:14.048565 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c7ef797b-2ea8-411b-9009-25b8808afa4d tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:14.048994 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c7ef797b-2ea8-411b-9009-25b8808afa4d tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:14.198283 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-c7ef797b-2ea8-411b-9009-25b8808afa4d tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:14.207717 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-c7ef797b-2ea8-411b-9009-25b8808afa4d tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1757 microversion: 2.1 time: 0.172692 Aug 30 01:05:14.208283 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 258/504] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:14 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:14.840485 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-30e021da-d97d-401b-935a-9dbbe91d4db6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:14.841110 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-30e021da-d97d-401b-935a-9dbbe91d4db6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:14.847502 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-30e021da-d97d-401b-935a-9dbbe91d4db6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:14.847981 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-30e021da-d97d-401b-935a-9dbbe91d4db6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:14.848416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-30e021da-d97d-401b-935a-9dbbe91d4db6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:14.849141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-30e021da-d97d-401b-935a-9dbbe91d4db6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:14.849595 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-30e021da-d97d-401b-935a-9dbbe91d4db6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:14.850024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-30e021da-d97d-401b-935a-9dbbe91d4db6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:14.980048 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-30e021da-d97d-401b-935a-9dbbe91d4db6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:14.987827 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-30e021da-d97d-401b-935a-9dbbe91d4db6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325" status: 200 len: 1367 microversion: 2.1 time: 0.151681 Aug 30 01:05:14.988393 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 247/505] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:14 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:15.229396 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-a38d318b-293e-4f88-9854-bf9955eae8ac tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:15.230535 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-a38d318b-293e-4f88-9854-bf9955eae8ac tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:15.237490 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a38d318b-293e-4f88-9854-bf9955eae8ac tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:15.237978 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a38d318b-293e-4f88-9854-bf9955eae8ac tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:15.238413 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a38d318b-293e-4f88-9854-bf9955eae8ac tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:15.239146 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a38d318b-293e-4f88-9854-bf9955eae8ac tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:15.239627 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a38d318b-293e-4f88-9854-bf9955eae8ac tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:15.240053 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a38d318b-293e-4f88-9854-bf9955eae8ac tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:15.390903 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-a38d318b-293e-4f88-9854-bf9955eae8ac tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:15.399281 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-a38d318b-293e-4f88-9854-bf9955eae8ac tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1757 microversion: 2.1 time: 0.173699 Aug 30 01:05:15.399896 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 259/506] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:15 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:16.009225 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-d30eadb7-8b57-4db5-919c-be8d5712d1ca tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:16.009914 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-d30eadb7-8b57-4db5-919c-be8d5712d1ca tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:16.016843 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d30eadb7-8b57-4db5-919c-be8d5712d1ca tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:16.017364 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d30eadb7-8b57-4db5-919c-be8d5712d1ca tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:16.017803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d30eadb7-8b57-4db5-919c-be8d5712d1ca tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:16.018501 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d30eadb7-8b57-4db5-919c-be8d5712d1ca tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:16.018976 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d30eadb7-8b57-4db5-919c-be8d5712d1ca tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:16.019377 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d30eadb7-8b57-4db5-919c-be8d5712d1ca tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:16.147520 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-d30eadb7-8b57-4db5-919c-be8d5712d1ca tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:16.156066 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-d30eadb7-8b57-4db5-919c-be8d5712d1ca tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325" status: 200 len: 1367 microversion: 2.1 time: 0.150733 Aug 30 01:05:16.156621 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 248/507] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:16 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:16.423257 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-2fbacf13-1d7d-4550-b383-388b982c9ebf tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:16.423866 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-2fbacf13-1d7d-4550-b383-388b982c9ebf tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:16.431637 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2fbacf13-1d7d-4550-b383-388b982c9ebf tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:16.432117 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2fbacf13-1d7d-4550-b383-388b982c9ebf tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:16.432549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2fbacf13-1d7d-4550-b383-388b982c9ebf tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:16.433267 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2fbacf13-1d7d-4550-b383-388b982c9ebf tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:16.434818 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2fbacf13-1d7d-4550-b383-388b982c9ebf tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:16.435247 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2fbacf13-1d7d-4550-b383-388b982c9ebf tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:16.579753 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-2fbacf13-1d7d-4550-b383-388b982c9ebf tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:16.588246 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-2fbacf13-1d7d-4550-b383-388b982c9ebf tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1757 microversion: 2.1 time: 0.168969 Aug 30 01:05:16.588855 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 260/508] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:16 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:17.085827 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-decd7fe1-31c9-450a-b225-739d18eb5a8e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52c36bad-005a-449a-a968-a61e36c0b72a"}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:05:17.088339 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-decd7fe1-31c9-450a-b225-739d18eb5a8e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:17.095569 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-decd7fe1-31c9-450a-b225-739d18eb5a8e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:17.096045 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-decd7fe1-31c9-450a-b225-739d18eb5a8e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:17.096473 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-decd7fe1-31c9-450a-b225-739d18eb5a8e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:17.097186 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-decd7fe1-31c9-450a-b225-739d18eb5a8e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:17.097663 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-decd7fe1-31c9-450a-b225-739d18eb5a8e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:17.098077 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-decd7fe1-31c9-450a-b225-739d18eb5a8e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:17.177630 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-c21f0133-96f0-424f-bbaa-51a2f0586e73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:17.178237 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-c21f0133-96f0-424f-bbaa-51a2f0586e73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:17.184815 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c21f0133-96f0-424f-bbaa-51a2f0586e73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:17.185341 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c21f0133-96f0-424f-bbaa-51a2f0586e73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:17.185786 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c21f0133-96f0-424f-bbaa-51a2f0586e73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:17.186480 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c21f0133-96f0-424f-bbaa-51a2f0586e73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:17.187036 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c21f0133-96f0-424f-bbaa-51a2f0586e73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:17.187677 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c21f0133-96f0-424f-bbaa-51a2f0586e73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:17.344517 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-c21f0133-96f0-424f-bbaa-51a2f0586e73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:17.354282 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-c21f0133-96f0-424f-bbaa-51a2f0586e73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325" status: 200 len: 1367 microversion: 2.1 time: 0.181324 Aug 30 01:05:17.354856 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 261/509] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:17 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:05:17.392151 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-eaf74efa-2e59-4f70-8f4b-7baccd92f1e8 req-4470104b-0843-4ffb-99f8-fd4f0271d9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af1febc-f5f3-440d-ab4b-0e33ac174325", "name": "network-vif-plugged", "status": "completed", "tag": "b0dd4618-5f7f-4366-b8dd-3fb92df6a2c1"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:05:17.403086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-eaf74efa-2e59-4f70-8f4b-7baccd92f1e8 req-4470104b-0843-4ffb-99f8-fd4f0271d9f8 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:17.403579 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-eaf74efa-2e59-4f70-8f4b-7baccd92f1e8 req-4470104b-0843-4ffb-99f8-fd4f0271d9f8 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:17.404011 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-eaf74efa-2e59-4f70-8f4b-7baccd92f1e8 req-4470104b-0843-4ffb-99f8-fd4f0271d9f8 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:17.417059 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-eaf74efa-2e59-4f70-8f4b-7baccd92f1e8 req-4470104b-0843-4ffb-99f8-fd4f0271d9f8 service nova] Creating event network-vif-plugged:b0dd4618-5f7f-4366-b8dd-3fb92df6a2c1 for instance 4af1febc-f5f3-440d-ab4b-0e33ac174325 on hv-cinder-81514 Aug 30 01:05:17.418291 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-decd7fe1-31c9-450a-b225-739d18eb5a8e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "POST /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.336156 Aug 30 01:05:17.419147 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 249/510] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 30 01:05:17 2022] POST /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:05:17.429730 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-eaf74efa-2e59-4f70-8f4b-7baccd92f1e8 req-4470104b-0843-4ffb-99f8-fd4f0271d9f8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041646 Aug 30 01:05:17.430463 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 262/511] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:05:17.610715 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-cceff6b0-b9e4-4358-ba1d-45e2231a217f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:17.611639 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-cceff6b0-b9e4-4358-ba1d-45e2231a217f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:17.617860 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cceff6b0-b9e4-4358-ba1d-45e2231a217f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:17.618339 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cceff6b0-b9e4-4358-ba1d-45e2231a217f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:17.618769 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cceff6b0-b9e4-4358-ba1d-45e2231a217f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:17.619453 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cceff6b0-b9e4-4358-ba1d-45e2231a217f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:17.619902 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cceff6b0-b9e4-4358-ba1d-45e2231a217f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:17.620320 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cceff6b0-b9e4-4358-ba1d-45e2231a217f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:17.762267 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-cceff6b0-b9e4-4358-ba1d-45e2231a217f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:17.771238 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-cceff6b0-b9e4-4358-ba1d-45e2231a217f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1757 microversion: 2.1 time: 0.164726 Aug 30 01:05:17.771842 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 250/512] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:17 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:18.375389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-9e800d16-f276-4bc3-b482-6fbc2caad630 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:18.376102 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-9e800d16-f276-4bc3-b482-6fbc2caad630 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:18.382298 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9e800d16-f276-4bc3-b482-6fbc2caad630 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:18.382771 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9e800d16-f276-4bc3-b482-6fbc2caad630 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:18.383199 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9e800d16-f276-4bc3-b482-6fbc2caad630 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:18.383878 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9e800d16-f276-4bc3-b482-6fbc2caad630 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:18.384319 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9e800d16-f276-4bc3-b482-6fbc2caad630 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:18.384736 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9e800d16-f276-4bc3-b482-6fbc2caad630 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:18.524282 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-9e800d16-f276-4bc3-b482-6fbc2caad630 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:18.532599 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-9e800d16-f276-4bc3-b482-6fbc2caad630 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325" status: 200 len: 1367 microversion: 2.1 time: 0.161344 Aug 30 01:05:18.533321 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 263/513] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:18 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:18.795737 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-68274de8-13b1-4377-9ef1-fc641b2afd46 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:18.796270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-68274de8-13b1-4377-9ef1-fc641b2afd46 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:18.802811 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-68274de8-13b1-4377-9ef1-fc641b2afd46 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:18.803291 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-68274de8-13b1-4377-9ef1-fc641b2afd46 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:18.803715 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-68274de8-13b1-4377-9ef1-fc641b2afd46 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:18.804403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-68274de8-13b1-4377-9ef1-fc641b2afd46 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:18.804849 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-68274de8-13b1-4377-9ef1-fc641b2afd46 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:18.805305 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-68274de8-13b1-4377-9ef1-fc641b2afd46 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:18.951543 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-68274de8-13b1-4377-9ef1-fc641b2afd46 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:18.959695 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-68274de8-13b1-4377-9ef1-fc641b2afd46 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1757 microversion: 2.1 time: 0.168716 Aug 30 01:05:18.960256 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 251/514] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:18 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:19.554641 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-72a0a483-ed84-4661-b62f-4e9ee642ec11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:19.555245 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-72a0a483-ed84-4661-b62f-4e9ee642ec11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:19.557194 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=2 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:19.557860 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=6 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:19.564765 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-72a0a483-ed84-4661-b62f-4e9ee642ec11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:19.565042 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-72a0a483-ed84-4661-b62f-4e9ee642ec11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:19.565503 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-72a0a483-ed84-4661-b62f-4e9ee642ec11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:19.566190 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-72a0a483-ed84-4661-b62f-4e9ee642ec11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:19.566639 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-72a0a483-ed84-4661-b62f-4e9ee642ec11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:19.567063 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-72a0a483-ed84-4661-b62f-4e9ee642ec11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:19.702062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-72a0a483-ed84-4661-b62f-4e9ee642ec11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:19.709710 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-72a0a483-ed84-4661-b62f-4e9ee642ec11 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325" status: 200 len: 1556 microversion: 2.1 time: 0.158986 Aug 30 01:05:19.710292 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 264/515] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:19 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:19.730375 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-7d070837-3321-47b3-94d9-f8628d7f99e4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:19.730979 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-7d070837-3321-47b3-94d9-f8628d7f99e4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:19.732918 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=6 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:19.738537 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7d070837-3321-47b3-94d9-f8628d7f99e4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:19.739017 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7d070837-3321-47b3-94d9-f8628d7f99e4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:19.739452 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7d070837-3321-47b3-94d9-f8628d7f99e4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:19.740140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7d070837-3321-47b3-94d9-f8628d7f99e4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:19.740592 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7d070837-3321-47b3-94d9-f8628d7f99e4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:19.741014 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7d070837-3321-47b3-94d9-f8628d7f99e4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:19.818482 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-7d070837-3321-47b3-94d9-f8628d7f99e4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091868 Aug 30 01:05:19.819107 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 252/516] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 30 01:05:19 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:05:19.981848 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-2b775ac3-2e5e-4651-bc14-afcaac3ef965 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:19.982747 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-2b775ac3-2e5e-4651-bc14-afcaac3ef965 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:19.992299 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2b775ac3-2e5e-4651-bc14-afcaac3ef965 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:19.992802 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2b775ac3-2e5e-4651-bc14-afcaac3ef965 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:19.993269 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2b775ac3-2e5e-4651-bc14-afcaac3ef965 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:19.994000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2b775ac3-2e5e-4651-bc14-afcaac3ef965 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:19.994447 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2b775ac3-2e5e-4651-bc14-afcaac3ef965 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:19.994874 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2b775ac3-2e5e-4651-bc14-afcaac3ef965 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:20.386802 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-2b775ac3-2e5e-4651-bc14-afcaac3ef965 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:20.397291 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-2b775ac3-2e5e-4651-bc14-afcaac3ef965 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1757 microversion: 2.1 time: 0.421017 Aug 30 01:05:20.397893 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 265/517] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:19 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1757 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:21.082275 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-efc4d7a2-bb91-4dea-b41c-048d5cab2bc7 req-4762f99a-9106-452f-865c-22a445b7f504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4af1febc-f5f3-440d-ab4b-0e33ac174325", "tag": "b0dd4618-5f7f-4366-b8dd-3fb92df6a2c1"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:05:21.092794 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-efc4d7a2-bb91-4dea-b41c-048d5cab2bc7 req-4762f99a-9106-452f-865c-22a445b7f504 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:21.093396 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-efc4d7a2-bb91-4dea-b41c-048d5cab2bc7 req-4762f99a-9106-452f-865c-22a445b7f504 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:21.093822 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-efc4d7a2-bb91-4dea-b41c-048d5cab2bc7 req-4762f99a-9106-452f-865c-22a445b7f504 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:21.097558 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:21.105368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-efc4d7a2-bb91-4dea-b41c-048d5cab2bc7 req-4762f99a-9106-452f-865c-22a445b7f504 service nova] Creating event network-changed:b0dd4618-5f7f-4366-b8dd-3fb92df6a2c1 for instance 4af1febc-f5f3-440d-ab4b-0e33ac174325 on hv-cinder-81514 Aug 30 01:05:21.112128 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-efc4d7a2-bb91-4dea-b41c-048d5cab2bc7 req-4762f99a-9106-452f-865c-22a445b7f504 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033945 Aug 30 01:05:21.112910 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 253/518] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:05:21.418025 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-ecda0798-d0cf-42ed-b3e1-4ad19361b933 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:21.418705 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-ecda0798-d0cf-42ed-b3e1-4ad19361b933 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:21.425120 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ecda0798-d0cf-42ed-b3e1-4ad19361b933 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:21.425845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ecda0798-d0cf-42ed-b3e1-4ad19361b933 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:21.426282 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ecda0798-d0cf-42ed-b3e1-4ad19361b933 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:21.426981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ecda0798-d0cf-42ed-b3e1-4ad19361b933 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:21.427434 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ecda0798-d0cf-42ed-b3e1-4ad19361b933 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:21.427863 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ecda0798-d0cf-42ed-b3e1-4ad19361b933 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:21.587417 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-ecda0798-d0cf-42ed-b3e1-4ad19361b933 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:21.596358 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-ecda0798-d0cf-42ed-b3e1-4ad19361b933 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1757 microversion: 2.1 time: 0.182092 Aug 30 01:05:21.597034 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 266/519] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:21 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:22.620709 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-2a49dcf3-1292-4724-9646-c6991238c585 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:22.621456 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-2a49dcf3-1292-4724-9646-c6991238c585 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:22.628589 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2a49dcf3-1292-4724-9646-c6991238c585 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:22.629068 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2a49dcf3-1292-4724-9646-c6991238c585 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:22.629522 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2a49dcf3-1292-4724-9646-c6991238c585 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:22.630203 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2a49dcf3-1292-4724-9646-c6991238c585 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:22.630654 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2a49dcf3-1292-4724-9646-c6991238c585 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:22.631073 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2a49dcf3-1292-4724-9646-c6991238c585 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:22.774141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-2a49dcf3-1292-4724-9646-c6991238c585 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:22.783444 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-2a49dcf3-1292-4724-9646-c6991238c585 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1757 microversion: 2.1 time: 0.167775 Aug 30 01:05:22.783994 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 254/520] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:22 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:23.803604 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-029e49f9-df1a-4224-9706-e647cbb5b613 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:23.804227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-029e49f9-df1a-4224-9706-e647cbb5b613 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:23.806613 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:23.811913 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-029e49f9-df1a-4224-9706-e647cbb5b613 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:23.812401 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-029e49f9-df1a-4224-9706-e647cbb5b613 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:23.812840 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-029e49f9-df1a-4224-9706-e647cbb5b613 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:23.813597 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-029e49f9-df1a-4224-9706-e647cbb5b613 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:23.814026 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-029e49f9-df1a-4224-9706-e647cbb5b613 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:23.814456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-029e49f9-df1a-4224-9706-e647cbb5b613 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:23.960047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-029e49f9-df1a-4224-9706-e647cbb5b613 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:23.962442 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:23.970882 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-029e49f9-df1a-4224-9706-e647cbb5b613 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1757 microversion: 2.1 time: 0.171133 Aug 30 01:05:23.971706 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 267/521] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:23 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:24.970824 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-c9e8d9c2-fe67-4eb8-9954-25bcf56cb147 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:05:24.973033 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-c9e8d9c2-fe67-4eb8-9954-25bcf56cb147 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:24.975522 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:24.981213 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c9e8d9c2-fe67-4eb8-9954-25bcf56cb147 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:24.981692 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c9e8d9c2-fe67-4eb8-9954-25bcf56cb147 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:24.982201 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c9e8d9c2-fe67-4eb8-9954-25bcf56cb147 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:24.982889 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c9e8d9c2-fe67-4eb8-9954-25bcf56cb147 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:24.983333 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c9e8d9c2-fe67-4eb8-9954-25bcf56cb147 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:24.983749 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c9e8d9c2-fe67-4eb8-9954-25bcf56cb147 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:24.993736 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-3f788741-dce6-4a1e-8846-530dcb68d2c9 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:24.994349 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-3f788741-dce6-4a1e-8846-530dcb68d2c9 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:25.002518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3f788741-dce6-4a1e-8846-530dcb68d2c9 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:25.003009 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3f788741-dce6-4a1e-8846-530dcb68d2c9 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:25.003447 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3f788741-dce6-4a1e-8846-530dcb68d2c9 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:25.004140 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3f788741-dce6-4a1e-8846-530dcb68d2c9 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:25.004592 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3f788741-dce6-4a1e-8846-530dcb68d2c9 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:25.005016 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3f788741-dce6-4a1e-8846-530dcb68d2c9 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:25.009260 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.objects.instance [None req-c9e8d9c2-fe67-4eb8-9954-25bcf56cb147 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lazy-loading 'flavor' on Instance uuid 2cff4036-ef80-4791-92b5-0c71c8e93582 {{(pid=120631) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:05:25.138272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-c9e8d9c2-fe67-4eb8-9954-25bcf56cb147 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "POST /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582/action" status: 200 len: 32 microversion: 2.1 time: 0.171405 Aug 30 01:05:25.138897 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 255/522] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 30 01:05:24 2022] POST /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:05:25.148767 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-c868a369-7760-42bd-b949-f6b2181c54ab tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:25.149502 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-c868a369-7760-42bd-b949-f6b2181c54ab tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:25.157422 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c868a369-7760-42bd-b949-f6b2181c54ab tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:25.157920 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c868a369-7760-42bd-b949-f6b2181c54ab tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:25.158350 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c868a369-7760-42bd-b949-f6b2181c54ab tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:25.158853 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-3f788741-dce6-4a1e-8846-530dcb68d2c9 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:25.159045 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c868a369-7760-42bd-b949-f6b2181c54ab tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:25.159488 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c868a369-7760-42bd-b949-f6b2181c54ab tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:25.159901 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c868a369-7760-42bd-b949-f6b2181c54ab tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:25.167964 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-3f788741-dce6-4a1e-8846-530dcb68d2c9 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1757 microversion: 2.1 time: 0.178498 Aug 30 01:05:25.170585 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 268/523] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:24 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:05:25.294504 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-c868a369-7760-42bd-b949-f6b2181c54ab tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:25.302970 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-c868a369-7760-42bd-b949-f6b2181c54ab tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1734 microversion: 2.1 time: 0.158308 Aug 30 01:05:25.303655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 256/524] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:25 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:26.191157 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-38d063ce-59f6-4460-aa9b-6323a7970761 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:26.191770 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-38d063ce-59f6-4460-aa9b-6323a7970761 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:26.198236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-38d063ce-59f6-4460-aa9b-6323a7970761 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:26.198723 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-38d063ce-59f6-4460-aa9b-6323a7970761 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:26.199221 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-38d063ce-59f6-4460-aa9b-6323a7970761 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:26.200352 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-38d063ce-59f6-4460-aa9b-6323a7970761 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:26.200810 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-38d063ce-59f6-4460-aa9b-6323a7970761 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:26.201449 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-38d063ce-59f6-4460-aa9b-6323a7970761 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:26.325202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-9a970c7f-846e-4448-9f63-317e12d4cbd3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:26.325867 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-9a970c7f-846e-4448-9f63-317e12d4cbd3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:26.332430 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9a970c7f-846e-4448-9f63-317e12d4cbd3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:26.332914 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9a970c7f-846e-4448-9f63-317e12d4cbd3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:26.333382 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9a970c7f-846e-4448-9f63-317e12d4cbd3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:26.334076 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9a970c7f-846e-4448-9f63-317e12d4cbd3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:26.334526 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9a970c7f-846e-4448-9f63-317e12d4cbd3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:26.334945 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9a970c7f-846e-4448-9f63-317e12d4cbd3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:26.346032 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-38d063ce-59f6-4460-aa9b-6323a7970761 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:26.354550 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-38d063ce-59f6-4460-aa9b-6323a7970761 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1757 microversion: 2.1 time: 0.167252 Aug 30 01:05:26.355122 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 269/525] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:26 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:26.461892 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-9a970c7f-846e-4448-9f63-317e12d4cbd3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:26.470805 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-9a970c7f-846e-4448-9f63-317e12d4cbd3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1734 microversion: 2.1 time: 0.150096 Aug 30 01:05:26.471366 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 257/526] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:26 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:05:27.376211 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-7d3b6316-214f-4170-b51d-113f6b07f326 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:27.376822 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-7d3b6316-214f-4170-b51d-113f6b07f326 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:27.383240 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7d3b6316-214f-4170-b51d-113f6b07f326 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:27.383721 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7d3b6316-214f-4170-b51d-113f6b07f326 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:27.384157 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7d3b6316-214f-4170-b51d-113f6b07f326 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:27.384841 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7d3b6316-214f-4170-b51d-113f6b07f326 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:27.385326 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7d3b6316-214f-4170-b51d-113f6b07f326 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:27.385750 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7d3b6316-214f-4170-b51d-113f6b07f326 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:27.491201 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-a98a30eb-56ad-4443-8800-304a0b986d75 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:27.491933 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-a98a30eb-56ad-4443-8800-304a0b986d75 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:27.498731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a98a30eb-56ad-4443-8800-304a0b986d75 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:27.499218 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a98a30eb-56ad-4443-8800-304a0b986d75 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:27.499654 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a98a30eb-56ad-4443-8800-304a0b986d75 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:27.500352 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a98a30eb-56ad-4443-8800-304a0b986d75 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:27.500805 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a98a30eb-56ad-4443-8800-304a0b986d75 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:27.501261 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a98a30eb-56ad-4443-8800-304a0b986d75 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:27.531238 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7d3b6316-214f-4170-b51d-113f6b07f326 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:27.539855 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-7d3b6316-214f-4170-b51d-113f6b07f326 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1757 microversion: 2.1 time: 0.168317 Aug 30 01:05:27.540420 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 270/527] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:27 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:27.634207 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-a98a30eb-56ad-4443-8800-304a0b986d75 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:27.643035 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-a98a30eb-56ad-4443-8800-304a0b986d75 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1734 microversion: 2.1 time: 0.155151 Aug 30 01:05:27.643035 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 258/528] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:27 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:05:28.563515 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-a31688c5-cb5a-4d43-be5c-9f749a667b53 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:28.564128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-a31688c5-cb5a-4d43-be5c-9f749a667b53 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:28.572325 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a31688c5-cb5a-4d43-be5c-9f749a667b53 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:28.573265 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a31688c5-cb5a-4d43-be5c-9f749a667b53 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:28.573722 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a31688c5-cb5a-4d43-be5c-9f749a667b53 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:28.574842 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a31688c5-cb5a-4d43-be5c-9f749a667b53 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:28.575362 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a31688c5-cb5a-4d43-be5c-9f749a667b53 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:28.576124 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a31688c5-cb5a-4d43-be5c-9f749a667b53 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:28.664657 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-13fd9fee-d0fd-4012-a180-f3fb2ba27b82 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:28.665320 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-13fd9fee-d0fd-4012-a180-f3fb2ba27b82 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:28.672299 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-13fd9fee-d0fd-4012-a180-f3fb2ba27b82 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:28.672779 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-13fd9fee-d0fd-4012-a180-f3fb2ba27b82 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:28.673252 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-13fd9fee-d0fd-4012-a180-f3fb2ba27b82 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:28.673952 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-13fd9fee-d0fd-4012-a180-f3fb2ba27b82 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:28.674403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-13fd9fee-d0fd-4012-a180-f3fb2ba27b82 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:28.674826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-13fd9fee-d0fd-4012-a180-f3fb2ba27b82 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:28.734738 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-a31688c5-cb5a-4d43-be5c-9f749a667b53 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:28.742913 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-a31688c5-cb5a-4d43-be5c-9f749a667b53 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1757 microversion: 2.1 time: 0.184062 Aug 30 01:05:28.743478 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 271/529] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:28 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:28.821386 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-13fd9fee-d0fd-4012-a180-f3fb2ba27b82 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:28.830000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-13fd9fee-d0fd-4012-a180-f3fb2ba27b82 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1734 microversion: 2.1 time: 0.169496 Aug 30 01:05:28.830558 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 259/530] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:28 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:05:29.764238 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-e84de6de-e5ff-4f91-9b86-bbad3b63172b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:29.764846 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-e84de6de-e5ff-4f91-9b86-bbad3b63172b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:29.771326 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e84de6de-e5ff-4f91-9b86-bbad3b63172b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:29.771837 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e84de6de-e5ff-4f91-9b86-bbad3b63172b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:29.772269 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e84de6de-e5ff-4f91-9b86-bbad3b63172b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:29.772975 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e84de6de-e5ff-4f91-9b86-bbad3b63172b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:29.773452 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e84de6de-e5ff-4f91-9b86-bbad3b63172b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:29.773971 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e84de6de-e5ff-4f91-9b86-bbad3b63172b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:29.851251 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-b65d1581-d219-4637-8e53-d35a70ce75ac tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:29.851842 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-b65d1581-d219-4637-8e53-d35a70ce75ac tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:29.859136 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b65d1581-d219-4637-8e53-d35a70ce75ac tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:29.859609 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b65d1581-d219-4637-8e53-d35a70ce75ac tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:29.860033 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b65d1581-d219-4637-8e53-d35a70ce75ac tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:29.860725 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b65d1581-d219-4637-8e53-d35a70ce75ac tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:29.861194 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b65d1581-d219-4637-8e53-d35a70ce75ac tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:29.861616 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b65d1581-d219-4637-8e53-d35a70ce75ac tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:29.953862 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-e84de6de-e5ff-4f91-9b86-bbad3b63172b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:29.962932 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-e84de6de-e5ff-4f91-9b86-bbad3b63172b tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1757 microversion: 2.1 time: 0.202512 Aug 30 01:05:29.963493 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 272/531] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:29 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1757 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:30.012874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-b65d1581-d219-4637-8e53-d35a70ce75ac tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:30.021209 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-b65d1581-d219-4637-8e53-d35a70ce75ac tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1734 microversion: 2.1 time: 0.173691 Aug 30 01:05:30.021705 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 260/532] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:29 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:05:30.985125 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-fac399b6-021b-4874-a0f5-260ad2583cea tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:30.985721 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-fac399b6-021b-4874-a0f5-260ad2583cea tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:30.991740 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fac399b6-021b-4874-a0f5-260ad2583cea tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:30.992213 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fac399b6-021b-4874-a0f5-260ad2583cea tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:30.992642 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fac399b6-021b-4874-a0f5-260ad2583cea tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:30.993347 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fac399b6-021b-4874-a0f5-260ad2583cea tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:30.993797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fac399b6-021b-4874-a0f5-260ad2583cea tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:30.994216 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fac399b6-021b-4874-a0f5-260ad2583cea tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:31.043213 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-f8afbad6-b05d-40bf-bf24-2805f57051b3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:31.043827 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-f8afbad6-b05d-40bf-bf24-2805f57051b3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:31.050131 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f8afbad6-b05d-40bf-bf24-2805f57051b3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:31.050607 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f8afbad6-b05d-40bf-bf24-2805f57051b3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:31.051036 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f8afbad6-b05d-40bf-bf24-2805f57051b3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:31.051723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f8afbad6-b05d-40bf-bf24-2805f57051b3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:31.052187 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f8afbad6-b05d-40bf-bf24-2805f57051b3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:31.052598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f8afbad6-b05d-40bf-bf24-2805f57051b3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:31.186208 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-fac399b6-021b-4874-a0f5-260ad2583cea tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:31.194428 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-fac399b6-021b-4874-a0f5-260ad2583cea tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1760 microversion: 2.1 time: 0.213367 Aug 30 01:05:31.194995 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 273/533] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:30 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1760 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:31.221387 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-f8afbad6-b05d-40bf-bf24-2805f57051b3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:31.229712 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-f8afbad6-b05d-40bf-bf24-2805f57051b3 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1734 microversion: 2.1 time: 0.190920 Aug 30 01:05:31.233341 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 261/534] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:31 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1734 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:05:32.251119 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-ad3eda26-b0da-43d9-91aa-dd09a040a20a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:32.251725 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-ad3eda26-b0da-43d9-91aa-dd09a040a20a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:32.258167 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ad3eda26-b0da-43d9-91aa-dd09a040a20a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:32.258655 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ad3eda26-b0da-43d9-91aa-dd09a040a20a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:32.259088 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ad3eda26-b0da-43d9-91aa-dd09a040a20a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:32.259781 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ad3eda26-b0da-43d9-91aa-dd09a040a20a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:32.260228 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ad3eda26-b0da-43d9-91aa-dd09a040a20a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:32.260902 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ad3eda26-b0da-43d9-91aa-dd09a040a20a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:32.389886 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-ad3eda26-b0da-43d9-91aa-dd09a040a20a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:32.397898 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-ad3eda26-b0da-43d9-91aa-dd09a040a20a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1734 microversion: 2.1 time: 0.150671 Aug 30 01:05:32.398457 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 274/535] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:32 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:33.419300 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-08e752f9-0851-4555-8b58-ca8e1a73a840 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:33.419905 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-08e752f9-0851-4555-8b58-ca8e1a73a840 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:33.426367 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-08e752f9-0851-4555-8b58-ca8e1a73a840 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:33.426870 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-08e752f9-0851-4555-8b58-ca8e1a73a840 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:33.427299 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-08e752f9-0851-4555-8b58-ca8e1a73a840 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:33.427977 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-08e752f9-0851-4555-8b58-ca8e1a73a840 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:33.428422 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-08e752f9-0851-4555-8b58-ca8e1a73a840 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:33.428838 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-08e752f9-0851-4555-8b58-ca8e1a73a840 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:33.555645 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-08e752f9-0851-4555-8b58-ca8e1a73a840 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:33.564666 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-08e752f9-0851-4555-8b58-ca8e1a73a840 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1734 microversion: 2.1 time: 0.149291 Aug 30 01:05:33.565275 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 262/536] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:33 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:34.585816 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-0a0425ca-8e09-4bab-ad75-b166e46924ee tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:34.586423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-0a0425ca-8e09-4bab-ad75-b166e46924ee tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:34.593519 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0a0425ca-8e09-4bab-ad75-b166e46924ee tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:34.593998 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0a0425ca-8e09-4bab-ad75-b166e46924ee tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:34.594430 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0a0425ca-8e09-4bab-ad75-b166e46924ee tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:34.595107 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0a0425ca-8e09-4bab-ad75-b166e46924ee tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:34.595550 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0a0425ca-8e09-4bab-ad75-b166e46924ee tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:34.595970 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0a0425ca-8e09-4bab-ad75-b166e46924ee tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:34.724065 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-0a0425ca-8e09-4bab-ad75-b166e46924ee tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:34.732679 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-0a0425ca-8e09-4bab-ad75-b166e46924ee tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1734 microversion: 2.1 time: 0.150708 Aug 30 01:05:34.733263 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 275/537] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:34 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:35.754392 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-88bb630b-e98d-437c-b4f0-b10294256574 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:35.755011 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-88bb630b-e98d-437c-b4f0-b10294256574 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:35.762516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-88bb630b-e98d-437c-b4f0-b10294256574 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:35.763007 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-88bb630b-e98d-437c-b4f0-b10294256574 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:35.763478 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-88bb630b-e98d-437c-b4f0-b10294256574 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:35.764180 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-88bb630b-e98d-437c-b4f0-b10294256574 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:35.764645 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-88bb630b-e98d-437c-b4f0-b10294256574 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:35.765069 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-88bb630b-e98d-437c-b4f0-b10294256574 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:35.892787 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-88bb630b-e98d-437c-b4f0-b10294256574 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:35.900976 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-88bb630b-e98d-437c-b4f0-b10294256574 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1734 microversion: 2.1 time: 0.150786 Aug 30 01:05:35.901573 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 263/538] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:35 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:36.923525 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-aba0fb90-ecd8-4207-9df4-cac8b09c6651 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:36.924174 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-aba0fb90-ecd8-4207-9df4-cac8b09c6651 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:36.930540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aba0fb90-ecd8-4207-9df4-cac8b09c6651 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:36.931057 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aba0fb90-ecd8-4207-9df4-cac8b09c6651 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:36.931497 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aba0fb90-ecd8-4207-9df4-cac8b09c6651 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:36.932181 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aba0fb90-ecd8-4207-9df4-cac8b09c6651 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:36.932636 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aba0fb90-ecd8-4207-9df4-cac8b09c6651 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:36.933062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aba0fb90-ecd8-4207-9df4-cac8b09c6651 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:37.066360 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-aba0fb90-ecd8-4207-9df4-cac8b09c6651 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:37.074722 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-aba0fb90-ecd8-4207-9df4-cac8b09c6651 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1734 microversion: 2.1 time: 0.154829 Aug 30 01:05:37.075331 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 276/539] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:36 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:05:38.095124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e06a2021-9fd1-4f5b-9a23-ede0fe63b7ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:38.095710 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e06a2021-9fd1-4f5b-9a23-ede0fe63b7ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:38.102293 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e06a2021-9fd1-4f5b-9a23-ede0fe63b7ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:38.102770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e06a2021-9fd1-4f5b-9a23-ede0fe63b7ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:38.103212 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e06a2021-9fd1-4f5b-9a23-ede0fe63b7ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:38.103880 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e06a2021-9fd1-4f5b-9a23-ede0fe63b7ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:38.104325 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e06a2021-9fd1-4f5b-9a23-ede0fe63b7ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:38.104741 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e06a2021-9fd1-4f5b-9a23-ede0fe63b7ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:38.233146 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e06a2021-9fd1-4f5b-9a23-ede0fe63b7ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:38.241280 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e06a2021-9fd1-4f5b-9a23-ede0fe63b7ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1734 microversion: 2.1 time: 0.149976 Aug 30 01:05:38.241851 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 264/540] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:38 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:39.262416 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8a021b5c-964f-4e12-9de3-41d532ee67d1 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:39.263024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8a021b5c-964f-4e12-9de3-41d532ee67d1 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:39.269480 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a021b5c-964f-4e12-9de3-41d532ee67d1 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:39.269961 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a021b5c-964f-4e12-9de3-41d532ee67d1 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:39.270393 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a021b5c-964f-4e12-9de3-41d532ee67d1 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:39.271075 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a021b5c-964f-4e12-9de3-41d532ee67d1 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:39.271522 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a021b5c-964f-4e12-9de3-41d532ee67d1 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:39.271940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8a021b5c-964f-4e12-9de3-41d532ee67d1 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:39.404528 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8a021b5c-964f-4e12-9de3-41d532ee67d1 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:39.413283 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8a021b5c-964f-4e12-9de3-41d532ee67d1 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1734 microversion: 2.1 time: 0.154807 Aug 30 01:05:39.413847 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 277/541] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:39 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:40.435433 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0912a1c3-5938-4b6a-a348-d496c6d13679 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:40.435954 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-0912a1c3-5938-4b6a-a348-d496c6d13679 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:40.442836 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0912a1c3-5938-4b6a-a348-d496c6d13679 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:40.443320 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0912a1c3-5938-4b6a-a348-d496c6d13679 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:40.443757 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0912a1c3-5938-4b6a-a348-d496c6d13679 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:40.444457 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0912a1c3-5938-4b6a-a348-d496c6d13679 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:40.444914 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0912a1c3-5938-4b6a-a348-d496c6d13679 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:40.445359 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0912a1c3-5938-4b6a-a348-d496c6d13679 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:40.574947 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-0912a1c3-5938-4b6a-a348-d496c6d13679 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:40.584390 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0912a1c3-5938-4b6a-a348-d496c6d13679 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1734 microversion: 2.1 time: 0.153504 Aug 30 01:05:40.584960 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 265/542] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:40 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:41.605110 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-3ebc887a-b3b1-48de-b4d1-17de3f209f8f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:41.606497 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-3ebc887a-b3b1-48de-b4d1-17de3f209f8f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:41.613013 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3ebc887a-b3b1-48de-b4d1-17de3f209f8f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:41.613531 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3ebc887a-b3b1-48de-b4d1-17de3f209f8f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:41.613970 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3ebc887a-b3b1-48de-b4d1-17de3f209f8f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:41.614657 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3ebc887a-b3b1-48de-b4d1-17de3f209f8f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:41.615109 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3ebc887a-b3b1-48de-b4d1-17de3f209f8f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:41.615530 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3ebc887a-b3b1-48de-b4d1-17de3f209f8f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:41.743681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-3ebc887a-b3b1-48de-b4d1-17de3f209f8f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:41.752265 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-3ebc887a-b3b1-48de-b4d1-17de3f209f8f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1734 microversion: 2.1 time: 0.151125 Aug 30 01:05:41.752826 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 278/543] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:41 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:42.775780 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e9f109a7-4cd6-47e0-9d50-e67d4ee1308d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:42.776302 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e9f109a7-4cd6-47e0-9d50-e67d4ee1308d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:42.783668 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e9f109a7-4cd6-47e0-9d50-e67d4ee1308d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:42.784150 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e9f109a7-4cd6-47e0-9d50-e67d4ee1308d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:42.784584 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e9f109a7-4cd6-47e0-9d50-e67d4ee1308d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:42.785316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e9f109a7-4cd6-47e0-9d50-e67d4ee1308d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:42.785763 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e9f109a7-4cd6-47e0-9d50-e67d4ee1308d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:42.786176 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e9f109a7-4cd6-47e0-9d50-e67d4ee1308d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:42.917055 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e9f109a7-4cd6-47e0-9d50-e67d4ee1308d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:42.925952 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e9f109a7-4cd6-47e0-9d50-e67d4ee1308d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1734 microversion: 2.1 time: 0.154583 Aug 30 01:05:42.926514 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 266/544] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:42 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:43.947771 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-82a87005-4206-456e-b88e-a5494fb6fa56 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:43.948382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-82a87005-4206-456e-b88e-a5494fb6fa56 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:43.955748 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-82a87005-4206-456e-b88e-a5494fb6fa56 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:43.956228 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-82a87005-4206-456e-b88e-a5494fb6fa56 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:43.956665 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-82a87005-4206-456e-b88e-a5494fb6fa56 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:43.957378 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-82a87005-4206-456e-b88e-a5494fb6fa56 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:43.957833 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-82a87005-4206-456e-b88e-a5494fb6fa56 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:43.958253 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-82a87005-4206-456e-b88e-a5494fb6fa56 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:44.085926 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-82a87005-4206-456e-b88e-a5494fb6fa56 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:44.094555 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-82a87005-4206-456e-b88e-a5494fb6fa56 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1714 microversion: 2.1 time: 0.150635 Aug 30 01:05:44.095123 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 279/545] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:43 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:44.155944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-5dc244c8-979c-446d-88b1-acdac29a2010 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:44.156433 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-5dc244c8-979c-446d-88b1-acdac29a2010 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:44.163074 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5dc244c8-979c-446d-88b1-acdac29a2010 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:44.163551 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5dc244c8-979c-446d-88b1-acdac29a2010 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:44.163979 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5dc244c8-979c-446d-88b1-acdac29a2010 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:44.164660 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5dc244c8-979c-446d-88b1-acdac29a2010 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:44.165129 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5dc244c8-979c-446d-88b1-acdac29a2010 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:44.165551 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5dc244c8-979c-446d-88b1-acdac29a2010 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:44.250133 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-5dc244c8-979c-446d-88b1-acdac29a2010 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] HTTP exception thrown: Cannot 'detach_volume' instance 2cff4036-ef80-4791-92b5-0c71c8e93582 while it is in vm_state rescued Aug 30 01:05:44.251761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-5dc244c8-979c-446d-88b1-acdac29a2010 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Request method failure captured: Aug 30 01:05:44.251761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: DELETE /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582/os-volume_attachments/52c36bad-005a-449a-a968-a61e36c0b72a HTTP/1.1 Aug 30 01:05:44.251761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:05:44.251761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:05:44.251761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:05:44.251761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:05:44.251761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:05:44.251761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:05:44.251761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:05:44.251761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:05:44.251761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWFZl1eXeWdEDlle0hI0paFtZlD2PL7IqHhMTCZh9t4-qj1yZKZ-oMZd8isPpWOq6EPoKdYey1DgasN-d057FigVzeaBK7xvIgMM59Rae3evOwrcybdKfuqMiKZ3wBQJQbTCDy7Hwhm_wrs2y5ZbRIUIowk7aEYT1BJ8gns6uC2nhJw Aug 30 01:05:44.251761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:05:44.251761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:05:44.251761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:05:44.251761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:05:44.251761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:05:44.251761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:05:44.251761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: ceebbaa5dd9d4110a6393190c5b466f0 Aug 30 01:05:44.251761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-436411527 Aug 30 01:05:44.251761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:05:44.251761 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:05:44.253424 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ceebbaa5dd9d4110a6393190c5b466f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ceebbaa5dd9d4110a6393190c5b466f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ceebbaa5dd9d4110a6393190c5b466f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ceebbaa5dd9d4110a6393190c5b466f0"}]}] Aug 30 01:05:44.253424 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-ServerRescueNegativeTestJSON-436411527 Aug 30 01:05:44.253424 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: ceebbaa5dd9d4110a6393190c5b466f0 Aug 30 01:05:44.253424 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-436411527 Aug 30 01:05:44.253424 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-ServerRescueNegativeTestJSON-436411527-project Aug 30 01:05:44.253424 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:05:44.253424 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:05:44.253424 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: 5c95c8ce27fd43c6a6fe10443b6bde13 Aug 30 01:05:44.253424 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-ServerRescueNegativeTestJSON-436411527-project Aug 30 01:05:44.253424 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:05:44.253424 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Cannot 'detach_volume' instance 2cff4036-ef80-4791-92b5-0c71c8e93582 while it is in vm_state rescued Aug 30 01:05:44.254250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'server_id': '2cff4036-ef80-4791-92b5-0c71c8e93582', 'id': '52c36bad-005a-449a-a968-a61e36c0b72a'} Aug 30 01:05:44.254250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:05:44.254250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:05:44.254250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 30 01:05:44.254250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 30 01:05:44.254250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 01:05:44.254250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 01:05:44.254250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 01:05:44.254250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 01:05:44.254250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2cff4036-ef80-4791-92b5-0c71c8e93582 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 30 01:05:44.254250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:05:44.254250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:05:44.254250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:05:44.254250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:05:44.254250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:05:44.254250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:05:44.254250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:05:44.254250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:05:44.254250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:05:44.254250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:05:44.255633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 30 01:05:44.255633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 01:05:44.255633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 01:05:44.255633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 01:05:44.255633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 2cff4036-ef80-4791-92b5-0c71c8e93582 while it is in vm_state rescued Aug 30 01:05:44.255633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:05:44.255633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:05:44.255633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:05:44.255633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:05:44.255633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:05:44.255633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:05:44.255633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:05:44.255633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:05:44.255633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 2cff4036-ef80-4791-92b5-0c71c8e93582 while it is in vm_state rescued Aug 30 01:05:44.255633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:05:44.255633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-5dc244c8-979c-446d-88b1-acdac29a2010 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Returning 409 to user: Cannot 'detach_volume' instance 2cff4036-ef80-4791-92b5-0c71c8e93582 while it is in vm_state rescued {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:05:44.256625 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-5dc244c8-979c-446d-88b1-acdac29a2010 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582/os-volume_attachments/52c36bad-005a-449a-a968-a61e36c0b72a" status: 409 len: 152 microversion: 2.1 time: 0.101442 Aug 30 01:05:44.256625 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 267/546] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 30 01:05:44 2022] DELETE /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582/os-volume_attachments/52c36bad-005a-449a-a968-a61e36c0b72a => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 01:05:44.265109 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-5df29012-7cf5-4ae2-97c8-9b2949a4446a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:05:44.265380 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-5df29012-7cf5-4ae2-97c8-9b2949a4446a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:44.272152 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5df29012-7cf5-4ae2-97c8-9b2949a4446a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:44.272635 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5df29012-7cf5-4ae2-97c8-9b2949a4446a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:44.273063 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5df29012-7cf5-4ae2-97c8-9b2949a4446a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:44.273770 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5df29012-7cf5-4ae2-97c8-9b2949a4446a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:44.274215 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5df29012-7cf5-4ae2-97c8-9b2949a4446a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:44.274636 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5df29012-7cf5-4ae2-97c8-9b2949a4446a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:44.349355 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-5df29012-7cf5-4ae2-97c8-9b2949a4446a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "POST /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582/action" status: 202 len: 0 microversion: 2.1 time: 0.090620 Aug 30 01:05:44.350017 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 280/547] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 30 01:05:44 2022] POST /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:05:44.358762 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-21e62d29-33be-4c2e-9dda-abb68a0ce8b7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:44.359379 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-21e62d29-33be-4c2e-9dda-abb68a0ce8b7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:44.366323 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-21e62d29-33be-4c2e-9dda-abb68a0ce8b7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:44.366809 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-21e62d29-33be-4c2e-9dda-abb68a0ce8b7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:44.367245 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-21e62d29-33be-4c2e-9dda-abb68a0ce8b7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:44.367943 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-21e62d29-33be-4c2e-9dda-abb68a0ce8b7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:44.368399 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-21e62d29-33be-4c2e-9dda-abb68a0ce8b7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:44.368828 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-21e62d29-33be-4c2e-9dda-abb68a0ce8b7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:44.387364 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:44.507862 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-21e62d29-33be-4c2e-9dda-abb68a0ce8b7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:44.517709 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-21e62d29-33be-4c2e-9dda-abb68a0ce8b7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1722 microversion: 2.1 time: 0.163354 Aug 30 01:05:44.518344 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 268/548] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:44 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:45.542172 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-1d14d416-ed41-490f-ae90-328831cc9363 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:45.542861 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-1d14d416-ed41-490f-ae90-328831cc9363 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:45.548884 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1d14d416-ed41-490f-ae90-328831cc9363 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:45.549397 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1d14d416-ed41-490f-ae90-328831cc9363 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:45.549827 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1d14d416-ed41-490f-ae90-328831cc9363 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:45.550504 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1d14d416-ed41-490f-ae90-328831cc9363 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:45.550949 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1d14d416-ed41-490f-ae90-328831cc9363 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:45.551368 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1d14d416-ed41-490f-ae90-328831cc9363 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:45.684325 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-1d14d416-ed41-490f-ae90-328831cc9363 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:45.692806 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-1d14d416-ed41-490f-ae90-328831cc9363 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1722 microversion: 2.1 time: 0.156636 Aug 30 01:05:45.693477 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 281/549] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:45 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:46.714710 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0590d246-7c06-4ec2-a711-6b3df9ebd617 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:46.715373 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-0590d246-7c06-4ec2-a711-6b3df9ebd617 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:46.721923 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0590d246-7c06-4ec2-a711-6b3df9ebd617 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:46.722417 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0590d246-7c06-4ec2-a711-6b3df9ebd617 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:46.722851 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0590d246-7c06-4ec2-a711-6b3df9ebd617 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:46.723552 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0590d246-7c06-4ec2-a711-6b3df9ebd617 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:46.724007 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0590d246-7c06-4ec2-a711-6b3df9ebd617 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:46.724429 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0590d246-7c06-4ec2-a711-6b3df9ebd617 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:46.861575 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-0590d246-7c06-4ec2-a711-6b3df9ebd617 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:46.869683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0590d246-7c06-4ec2-a711-6b3df9ebd617 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1722 microversion: 2.1 time: 0.158959 Aug 30 01:05:46.870241 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 269/550] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:46 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:47.891684 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-1b5c85e1-2d6a-4f34-b487-806672b7f27e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:47.892317 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-1b5c85e1-2d6a-4f34-b487-806672b7f27e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:47.898632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1b5c85e1-2d6a-4f34-b487-806672b7f27e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:47.899114 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1b5c85e1-2d6a-4f34-b487-806672b7f27e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:47.899549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1b5c85e1-2d6a-4f34-b487-806672b7f27e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:47.900228 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1b5c85e1-2d6a-4f34-b487-806672b7f27e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:47.900674 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1b5c85e1-2d6a-4f34-b487-806672b7f27e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:47.901109 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1b5c85e1-2d6a-4f34-b487-806672b7f27e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:48.031310 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-1b5c85e1-2d6a-4f34-b487-806672b7f27e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:48.039727 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-1b5c85e1-2d6a-4f34-b487-806672b7f27e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1728 microversion: 2.1 time: 0.152505 Aug 30 01:05:48.040302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 282/551] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:47 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:48.061259 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-29a98056-bb2a-4341-ae3c-c7a7a96c99d7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:48.061809 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-29a98056-bb2a-4341-ae3c-c7a7a96c99d7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:48.067989 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-29a98056-bb2a-4341-ae3c-c7a7a96c99d7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:48.068463 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-29a98056-bb2a-4341-ae3c-c7a7a96c99d7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:48.068892 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-29a98056-bb2a-4341-ae3c-c7a7a96c99d7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:48.069620 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-29a98056-bb2a-4341-ae3c-c7a7a96c99d7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:48.070069 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-29a98056-bb2a-4341-ae3c-c7a7a96c99d7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:48.070495 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-29a98056-bb2a-4341-ae3c-c7a7a96c99d7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:48.149397 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-29a98056-bb2a-4341-ae3c-c7a7a96c99d7 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092598 Aug 30 01:05:48.150020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 270/552] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 30 01:05:48 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:05:49.253222 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-f7c83595-a35d-4ad2-8352-74f3c90c3505 req-95a6d456-b532-435e-b961-735e8b736112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cff4036-ef80-4791-92b5-0c71c8e93582", "tag": "737df1fc-0996-483b-b4f3-e6055a0f4df0"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:05:49.267121 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-f7c83595-a35d-4ad2-8352-74f3c90c3505 req-95a6d456-b532-435e-b961-735e8b736112 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:49.267614 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-f7c83595-a35d-4ad2-8352-74f3c90c3505 req-95a6d456-b532-435e-b961-735e8b736112 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:49.268048 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-f7c83595-a35d-4ad2-8352-74f3c90c3505 req-95a6d456-b532-435e-b961-735e8b736112 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:49.283194 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-f7c83595-a35d-4ad2-8352-74f3c90c3505 req-95a6d456-b532-435e-b961-735e8b736112 service nova] Creating event network-changed:737df1fc-0996-483b-b4f3-e6055a0f4df0 for instance 2cff4036-ef80-4791-92b5-0c71c8e93582 on hv-cinder-81514 Aug 30 01:05:49.288429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-f7c83595-a35d-4ad2-8352-74f3c90c3505 req-95a6d456-b532-435e-b961-735e8b736112 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039018 Aug 30 01:05:49.289154 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 283/553] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:05:51.304194 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-32128b78-f2aa-492e-b594-38eabf67cc35 req-14ce3364-c427-4630-92d5-66dcee67c715 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cff4036-ef80-4791-92b5-0c71c8e93582", "tag": "737df1fc-0996-483b-b4f3-e6055a0f4df0"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:05:51.314131 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-32128b78-f2aa-492e-b594-38eabf67cc35 req-14ce3364-c427-4630-92d5-66dcee67c715 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:51.314607 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-32128b78-f2aa-492e-b594-38eabf67cc35 req-14ce3364-c427-4630-92d5-66dcee67c715 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:51.315036 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-32128b78-f2aa-492e-b594-38eabf67cc35 req-14ce3364-c427-4630-92d5-66dcee67c715 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:51.326443 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-32128b78-f2aa-492e-b594-38eabf67cc35 req-14ce3364-c427-4630-92d5-66dcee67c715 service nova] Creating event network-changed:737df1fc-0996-483b-b4f3-e6055a0f4df0 for instance 2cff4036-ef80-4791-92b5-0c71c8e93582 on hv-cinder-81514 Aug 30 01:05:51.331340 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-32128b78-f2aa-492e-b594-38eabf67cc35 req-14ce3364-c427-4630-92d5-66dcee67c715 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031333 Aug 30 01:05:51.331904 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 271/554] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:07.548770 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=33 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:07.549477 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:07.554237 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f2361d97-2087-4626-a00a-5a8c835e0c8f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:07.554821 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-f2361d97-2087-4626-a00a-5a8c835e0c8f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:07.562237 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f2361d97-2087-4626-a00a-5a8c835e0c8f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:07.562724 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f2361d97-2087-4626-a00a-5a8c835e0c8f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:07.563164 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f2361d97-2087-4626-a00a-5a8c835e0c8f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:07.563856 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f2361d97-2087-4626-a00a-5a8c835e0c8f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:07.564310 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f2361d97-2087-4626-a00a-5a8c835e0c8f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:07.564738 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f2361d97-2087-4626-a00a-5a8c835e0c8f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:07.588916 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-f2361d97-2087-4626-a00a-5a8c835e0c8f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/ips" status: 200 len: 148 microversion: 2.1 time: 0.042075 Aug 30 01:06:07.589518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 284/555] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 30 01:06:07 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/ips => generated 148 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:08.917951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=33 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:08.918694 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=14 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:08.923525 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0a2a4a3c-a11d-4250-a2bd-5ce8f23bfc4c tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1399c15-f5da-47be-bf98-3c359f755f49"}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:08.925920 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-0a2a4a3c-a11d-4250-a2bd-5ce8f23bfc4c tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:08.932829 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0a2a4a3c-a11d-4250-a2bd-5ce8f23bfc4c tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:08.933338 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0a2a4a3c-a11d-4250-a2bd-5ce8f23bfc4c tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:08.933775 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0a2a4a3c-a11d-4250-a2bd-5ce8f23bfc4c tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:08.934474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0a2a4a3c-a11d-4250-a2bd-5ce8f23bfc4c tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:08.934927 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0a2a4a3c-a11d-4250-a2bd-5ce8f23bfc4c tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:08.935348 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0a2a4a3c-a11d-4250-a2bd-5ce8f23bfc4c tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:09.279341 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0a2a4a3c-a11d-4250-a2bd-5ce8f23bfc4c tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "POST /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362694 Aug 30 01:06:09.280944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 272/556] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 30 01:06:08 2022] POST /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/os-volume_attachments => generated 194 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:12.999083 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-b1b9b3a1-8035-4e0e-8ede-b7a85a641f57 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1868053050"}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:12.999658 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-b1b9b3a1-8035-4e0e-8ede-b7a85a641f57 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:13.006857 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b1b9b3a1-8035-4e0e-8ede-b7a85a641f57 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:13.007372 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b1b9b3a1-8035-4e0e-8ede-b7a85a641f57 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:13.007812 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b1b9b3a1-8035-4e0e-8ede-b7a85a641f57 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:13.008503 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b1b9b3a1-8035-4e0e-8ede-b7a85a641f57 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:13.008956 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b1b9b3a1-8035-4e0e-8ede-b7a85a641f57 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:13.009408 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b1b9b3a1-8035-4e0e-8ede-b7a85a641f57 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:13.185363 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.network.security_group_api [None req-b1b9b3a1-8035-4e0e-8ede-b7a85a641f57 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Removing security group fc98e544-5446-4a9d-95b5-00310bfa492a from port e2481fa1-2595-4100-98cf-07e796517813 Aug 30 01:06:13.497369 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-b1b9b3a1-8035-4e0e-8ede-b7a85a641f57 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "POST /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371/action" status: 202 len: 0 microversion: 2.1 time: 0.502119 Aug 30 01:06:13.498148 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 285/557] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 30 01:06:12 2022] POST /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:06:13.510451 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-ddffb19f-f876-4e0f-bef9-14af84a9e587 req-a61e58df-8fd7-468e-8b7a-2df601439864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5598be2a-00db-4303-bc81-a7fb3674e371", "tag": "e2481fa1-2595-4100-98cf-07e796517813"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:13.533771 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-ddffb19f-f876-4e0f-bef9-14af84a9e587 req-a61e58df-8fd7-468e-8b7a-2df601439864 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:13.534120 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-ddffb19f-f876-4e0f-bef9-14af84a9e587 req-a61e58df-8fd7-468e-8b7a-2df601439864 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:13.534550 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-ddffb19f-f876-4e0f-bef9-14af84a9e587 req-a61e58df-8fd7-468e-8b7a-2df601439864 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:13.566856 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-ddffb19f-f876-4e0f-bef9-14af84a9e587 req-a61e58df-8fd7-468e-8b7a-2df601439864 service nova] Creating event network-changed:e2481fa1-2595-4100-98cf-07e796517813 for instance 5598be2a-00db-4303-bc81-a7fb3674e371 on hv-cinder-81514 Aug 30 01:06:13.581288 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-ddffb19f-f876-4e0f-bef9-14af84a9e587 req-a61e58df-8fd7-468e-8b7a-2df601439864 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076649 Aug 30 01:06:13.581288 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 273/558] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:14.829717 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-6d965339-3908-4fb4-b344-9c0a93cef153 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:14.830243 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-6d965339-3908-4fb4-b344-9c0a93cef153 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:14.836167 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6d965339-3908-4fb4-b344-9c0a93cef153 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:14.836662 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6d965339-3908-4fb4-b344-9c0a93cef153 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:14.837104 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6d965339-3908-4fb4-b344-9c0a93cef153 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:14.837783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6d965339-3908-4fb4-b344-9c0a93cef153 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:14.838235 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6d965339-3908-4fb4-b344-9c0a93cef153 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:14.838657 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6d965339-3908-4fb4-b344-9c0a93cef153 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:14.922916 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.objects.instance [None req-6d965339-3908-4fb4-b344-9c0a93cef153 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lazy-loading 'services' on Instance uuid 5598be2a-00db-4303-bc81-a7fb3674e371 {{(pid=120630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:06:14.994244 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-6d965339-3908-4fb4-b344-9c0a93cef153 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371/os-volume_attachments/b5d52ff1-2b30-4129-88db-4c1c9eb24be7" status: 202 len: 0 microversion: 2.1 time: 0.169451 Aug 30 01:06:14.994825 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 286/559] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 30 01:06:14 2022] DELETE /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371/os-volume_attachments/b5d52ff1-2b30-4129-88db-4c1c9eb24be7 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:06:15.004197 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-1a9ed08b-7506-4787-92a7-2f34daeeef0f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:15.006430 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-1a9ed08b-7506-4787-92a7-2f34daeeef0f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:15.012503 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1a9ed08b-7506-4787-92a7-2f34daeeef0f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:15.012988 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1a9ed08b-7506-4787-92a7-2f34daeeef0f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:15.013457 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1a9ed08b-7506-4787-92a7-2f34daeeef0f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:15.014140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1a9ed08b-7506-4787-92a7-2f34daeeef0f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:15.014586 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1a9ed08b-7506-4787-92a7-2f34daeeef0f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:15.015004 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1a9ed08b-7506-4787-92a7-2f34daeeef0f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:15.048712 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-1a9ed08b-7506-4787-92a7-2f34daeeef0f tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049310 Aug 30 01:06:15.049383 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 274/560] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:06:14 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:15.597789 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-816d8ed1-9ac4-4e74-84cc-3eaf649983bc req-dad60ddd-25c7-4f23-b661-92e81ee25b05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5598be2a-00db-4303-bc81-a7fb3674e371", "tag": "e2481fa1-2595-4100-98cf-07e796517813"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:15.607742 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-816d8ed1-9ac4-4e74-84cc-3eaf649983bc req-dad60ddd-25c7-4f23-b661-92e81ee25b05 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:15.608305 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-816d8ed1-9ac4-4e74-84cc-3eaf649983bc req-dad60ddd-25c7-4f23-b661-92e81ee25b05 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:15.608747 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-816d8ed1-9ac4-4e74-84cc-3eaf649983bc req-dad60ddd-25c7-4f23-b661-92e81ee25b05 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:15.620886 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-816d8ed1-9ac4-4e74-84cc-3eaf649983bc req-dad60ddd-25c7-4f23-b661-92e81ee25b05 service nova] Creating event network-changed:e2481fa1-2595-4100-98cf-07e796517813 for instance 5598be2a-00db-4303-bc81-a7fb3674e371 on hv-cinder-81514 Aug 30 01:06:15.625910 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-816d8ed1-9ac4-4e74-84cc-3eaf649983bc req-dad60ddd-25c7-4f23-b661-92e81ee25b05 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032686 Aug 30 01:06:15.626505 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 287/561] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:16.060736 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-12e74272-7e22-45a0-875b-8bfb78a1d1c0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:16.062967 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-12e74272-7e22-45a0-875b-8bfb78a1d1c0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:16.069480 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-12e74272-7e22-45a0-875b-8bfb78a1d1c0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:16.069950 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-12e74272-7e22-45a0-875b-8bfb78a1d1c0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:16.070377 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-12e74272-7e22-45a0-875b-8bfb78a1d1c0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:16.071051 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-12e74272-7e22-45a0-875b-8bfb78a1d1c0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:16.071496 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-12e74272-7e22-45a0-875b-8bfb78a1d1c0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:16.071909 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-12e74272-7e22-45a0-875b-8bfb78a1d1c0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:16.100957 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-12e74272-7e22-45a0-875b-8bfb78a1d1c0 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044125 Aug 30 01:06:16.101544 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 275/562] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:06:16 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:16.829734 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-745883ef-03eb-4daa-bdb1-249be08b2f6e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:16.832064 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-745883ef-03eb-4daa-bdb1-249be08b2f6e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:16.837069 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-966ade84-5e92-4f94-8dbb-89f89fa49511 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1399c15-f5da-47be-bf98-3c359f755f49"}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:16.838345 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-745883ef-03eb-4daa-bdb1-249be08b2f6e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:16.838900 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-745883ef-03eb-4daa-bdb1-249be08b2f6e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:16.839402 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-745883ef-03eb-4daa-bdb1-249be08b2f6e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:16.839517 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-966ade84-5e92-4f94-8dbb-89f89fa49511 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:16.840218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-745883ef-03eb-4daa-bdb1-249be08b2f6e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:16.840731 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-745883ef-03eb-4daa-bdb1-249be08b2f6e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:16.841265 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-745883ef-03eb-4daa-bdb1-249be08b2f6e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:16.846050 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-966ade84-5e92-4f94-8dbb-89f89fa49511 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:16.846534 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-966ade84-5e92-4f94-8dbb-89f89fa49511 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:16.846967 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-966ade84-5e92-4f94-8dbb-89f89fa49511 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:16.847659 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-966ade84-5e92-4f94-8dbb-89f89fa49511 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:16.848109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-966ade84-5e92-4f94-8dbb-89f89fa49511 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:16.848533 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-966ade84-5e92-4f94-8dbb-89f89fa49511 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:16.870108 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-745883ef-03eb-4daa-bdb1-249be08b2f6e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045746 Aug 30 01:06:16.870665 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 288/563] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:06:16 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:06:16.930583 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-966ade84-5e92-4f94-8dbb-89f89fa49511 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] HTTP exception thrown: Invalid volume: volume c1399c15-f5da-47be-bf98-3c359f755f49 is already attached to instances: 4af1febc-f5f3-440d-ab4b-0e33ac174325 Aug 30 01:06:16.932331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-966ade84-5e92-4f94-8dbb-89f89fa49511 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Request method failure captured: Aug 30 01:06:16.932331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: POST /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/os-volume_attachments HTTP/1.1 Aug 30 01:06:16.932331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:06:16.932331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:06:16.932331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:06:16.932331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 74 Aug 30 01:06:16.932331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:06:16.932331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:06:16.932331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:06:16.932331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:06:16.932331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWFfZmUwgQ0mFuieojBsvktSnruxexkMD8R8bd6MnZKGHmPnXPTUGPvemFUgtcXUu8u-yzCNpJULMfiAasm8f-KjX-nH3CChWEIyCAavljtkV9ICnALTHbbll4hz4f_VNsMQOGGKv1XAa5uQHI8I8bGS718FQfoeBt-22Hj_CVvvdxo Aug 30 01:06:16.932331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:06:16.932331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:06:16.932331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:06:16.932331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:06:16.932331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:06:16.932331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:06:16.932331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:06:16.932331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:06:16.932331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:06:16.932331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:06:16.933986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0596692dbfb149139a1e72159c6f93db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}] Aug 30 01:06:16.933986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:06:16.933986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:06:16.933986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:06:16.933986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:06:16.933986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:06:16.933986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:06:16.933986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: cc7cf306aadb45d1b65252b53c86b612 Aug 30 01:06:16.933986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:06:16.933986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Aug 30 01:06:16.933986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {"volumeAttachment": {"volumeId": "c1399c15-f5da-47be-bf98-3c359f755f49"}} Aug 30 01:06:16.933986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:06:16.934864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Invalid volume: volume c1399c15-f5da-47be-bf98-3c359f755f49 is already attached to instances: 4af1febc-f5f3-440d-ab4b-0e33ac174325 Aug 30 01:06:16.934864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'server_id': '4af1febc-f5f3-440d-ab4b-0e33ac174325', 'body': {'volumeAttachment': {'volumeId': 'c1399c15-f5da-47be-bf98-3c359f755f49'}}} Aug 30 01:06:16.934864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:06:16.934864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:16.934864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 01:06:16.934864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 01:06:16.934864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 01:06:16.934864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 01:06:16.934864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 01:06:16.934864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 01:06:16.934864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 01:06:16.934864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 01:06:16.934864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 01:06:16.934864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 01:06:16.934864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c1399c15-f5da-47be-bf98-3c359f755f49 is already attached to instances: 4af1febc-f5f3-440d-ab4b-0e33ac174325 Aug 30 01:06:16.934864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:16.934864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:16.934864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:16.934864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:16.936204 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:16.936204 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:16.936204 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:06:16.936204 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:06:16.936204 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:06:16.936204 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:06:16.936204 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:06:16.936204 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:06:16.936204 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:06:16.936204 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:06:16.936204 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:06:16.936204 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:06:16.936204 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 01:06:16.936204 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 01:06:16.936204 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c1399c15-f5da-47be-bf98-3c359f755f49 is already attached to instances: 4af1febc-f5f3-440d-ab4b-0e33ac174325 Aug 30 01:06:16.936204 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:16.936204 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:16.936204 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:16.936204 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:16.936204 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:16.941767 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:16.941767 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:06:16.941767 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:06:16.941767 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c1399c15-f5da-47be-bf98-3c359f755f49 is already attached to instances: 4af1febc-f5f3-440d-ab4b-0e33ac174325 Aug 30 01:06:16.941767 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:16.941767 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-966ade84-5e92-4f94-8dbb-89f89fa49511 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Returning 400 to user: Invalid volume: volume c1399c15-f5da-47be-bf98-3c359f755f49 is already attached to instances: 4af1febc-f5f3-440d-ab4b-0e33ac174325 {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:06:16.942217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-c0efd3e0-7d34-4641-aca7-5da629c03212 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:16.942217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-c0efd3e0-7d34-4641-aca7-5da629c03212 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:16.942392 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-966ade84-5e92-4f94-8dbb-89f89fa49511 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "POST /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102113 Aug 30 01:06:16.942392 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 276/564] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 30 01:06:16 2022] POST /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 01:06:16.942556 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c0efd3e0-7d34-4641-aca7-5da629c03212 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:16.942556 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c0efd3e0-7d34-4641-aca7-5da629c03212 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:16.943109 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c0efd3e0-7d34-4641-aca7-5da629c03212 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:16.943614 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c0efd3e0-7d34-4641-aca7-5da629c03212 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:16.944071 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c0efd3e0-7d34-4641-aca7-5da629c03212 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:16.944499 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c0efd3e0-7d34-4641-aca7-5da629c03212 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:16.969729 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-c0efd3e0-7d34-4641-aca7-5da629c03212 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Going to try to terminate instance {{(pid=120630) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:06:16.999738 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-f3fcbad1-e580-47af-afbb-d95974af66a4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:17.000853 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-f3fcbad1-e580-47af-afbb-d95974af66a4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:17.007249 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f3fcbad1-e580-47af-afbb-d95974af66a4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:17.007794 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f3fcbad1-e580-47af-afbb-d95974af66a4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:17.008232 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f3fcbad1-e580-47af-afbb-d95974af66a4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:17.009021 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f3fcbad1-e580-47af-afbb-d95974af66a4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:17.009589 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f3fcbad1-e580-47af-afbb-d95974af66a4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:17.010220 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f3fcbad1-e580-47af-afbb-d95974af66a4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:17.052208 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-c0efd3e0-7d34-4641-aca7-5da629c03212 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 204 len: 0 microversion: 2.1 time: 0.119967 Aug 30 01:06:17.053276 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 289/565] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:06:16 2022] DELETE /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 01:06:17.063310 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-c6fd3d11-230c-4c94-b0a8-5e94f90eadf0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:17.064007 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-c6fd3d11-230c-4c94-b0a8-5e94f90eadf0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:17.069912 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c6fd3d11-230c-4c94-b0a8-5e94f90eadf0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:17.070390 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c6fd3d11-230c-4c94-b0a8-5e94f90eadf0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:17.070823 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c6fd3d11-230c-4c94-b0a8-5e94f90eadf0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:17.071509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c6fd3d11-230c-4c94-b0a8-5e94f90eadf0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:17.071952 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c6fd3d11-230c-4c94-b0a8-5e94f90eadf0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:17.072372 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c6fd3d11-230c-4c94-b0a8-5e94f90eadf0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:17.099172 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.objects.instance [None req-f3fcbad1-e580-47af-afbb-d95974af66a4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lazy-loading 'services' on Instance uuid 4af1febc-f5f3-440d-ab4b-0e33ac174325 {{(pid=120631) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:06:17.172934 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-f3fcbad1-e580-47af-afbb-d95974af66a4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/os-volume_attachments/c1399c15-f5da-47be-bf98-3c359f755f49" status: 202 len: 0 microversion: 2.1 time: 0.176694 Aug 30 01:06:17.173847 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 277/566] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 30 01:06:16 2022] DELETE /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/os-volume_attachments/c1399c15-f5da-47be-bf98-3c359f755f49 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:06:17.179148 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-9f8a96b7-4d25-44df-91fa-bd505bc53378 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:17.181738 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-9f8a96b7-4d25-44df-91fa-bd505bc53378 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:17.188465 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9f8a96b7-4d25-44df-91fa-bd505bc53378 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:17.188879 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9f8a96b7-4d25-44df-91fa-bd505bc53378 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:17.189336 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9f8a96b7-4d25-44df-91fa-bd505bc53378 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:17.190026 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9f8a96b7-4d25-44df-91fa-bd505bc53378 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:17.190472 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9f8a96b7-4d25-44df-91fa-bd505bc53378 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:17.190888 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9f8a96b7-4d25-44df-91fa-bd505bc53378 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:17.206416 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-c6fd3d11-230c-4c94-b0a8-5e94f90eadf0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:17.214342 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-c6fd3d11-230c-4c94-b0a8-5e94f90eadf0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1669 microversion: 2.1 time: 0.155651 Aug 30 01:06:17.214910 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 290/567] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:17 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:06:17.221094 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-bf19603e-3757-4e1a-927c-a80f3e16dd7d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:17.223227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-bf19603e-3757-4e1a-927c-a80f3e16dd7d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:17.223753 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-9f8a96b7-4d25-44df-91fa-bd505bc53378 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048666 Aug 30 01:06:17.224669 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 278/568] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:06:17 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:06:17.230039 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bf19603e-3757-4e1a-927c-a80f3e16dd7d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:17.230609 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bf19603e-3757-4e1a-927c-a80f3e16dd7d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:17.231118 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bf19603e-3757-4e1a-927c-a80f3e16dd7d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:17.231884 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bf19603e-3757-4e1a-927c-a80f3e16dd7d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:17.232339 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bf19603e-3757-4e1a-927c-a80f3e16dd7d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:17.232767 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bf19603e-3757-4e1a-927c-a80f3e16dd7d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:17.235107 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-b5ce6de3-393a-4cb9-b707-84c53b8ed026 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:17.235856 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-b5ce6de3-393a-4cb9-b707-84c53b8ed026 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:17.241839 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b5ce6de3-393a-4cb9-b707-84c53b8ed026 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:17.242329 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b5ce6de3-393a-4cb9-b707-84c53b8ed026 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:17.242768 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b5ce6de3-393a-4cb9-b707-84c53b8ed026 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:17.243478 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b5ce6de3-393a-4cb9-b707-84c53b8ed026 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:17.243955 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b5ce6de3-393a-4cb9-b707-84c53b8ed026 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:17.244363 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b5ce6de3-393a-4cb9-b707-84c53b8ed026 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:17.265644 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-bf19603e-3757-4e1a-927c-a80f3e16dd7d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049533 Aug 30 01:06:17.266303 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 291/569] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:06:17 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:17.321614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-b5ce6de3-393a-4cb9-b707-84c53b8ed026 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] HTTP exception thrown: Instance 5598be2a-00db-4303-bc81-a7fb3674e371 is not attached to volume b5d52ff1-2b30-4129-88db-4c1c9eb24be7 Aug 30 01:06:17.324008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-b5ce6de3-393a-4cb9-b707-84c53b8ed026 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Request method failure captured: Aug 30 01:06:17.324008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: DELETE /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371/os-volume_attachments/b5d52ff1-2b30-4129-88db-4c1c9eb24be7 HTTP/1.1 Aug 30 01:06:17.324008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:06:17.324008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:06:17.324008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:06:17.324008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:06:17.324008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:06:17.324008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:06:17.324008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:06:17.324008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:06:17.324008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWHXeVUbhjvamuZZtlAp8qv6ZRt7Z_qVtslvX5p0lzqsanFq_t2lf1W077EVrNmAUaL2pT4Ow-jSi7ncPOQ_cFhszvRcQPKuCa_tItvTvMZpSaoEsJ_j88EXIs0XZqmyCw94S_q8s93AWYvHAraEt-iZ927EJrAo0cETpGu8WNyk4bo Aug 30 01:06:17.324008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:06:17.324008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:06:17.324008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:06:17.324008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:06:17.324008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:06:17.324008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:06:17.324008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: fca43fd867154911badb413c7046befd Aug 30 01:06:17.324008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-TestMinimumBasicScenario-34717424 Aug 30 01:06:17.324008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:06:17.324008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:06:17.325561 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fca43fd867154911badb413c7046befd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fca43fd867154911badb413c7046befd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fca43fd867154911badb413c7046befd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fca43fd867154911badb413c7046befd"}]}] Aug 30 01:06:17.325561 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-TestMinimumBasicScenario-34717424 Aug 30 01:06:17.325561 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: fca43fd867154911badb413c7046befd Aug 30 01:06:17.325561 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-TestMinimumBasicScenario-34717424 Aug 30 01:06:17.325561 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-TestMinimumBasicScenario-34717424-project Aug 30 01:06:17.325561 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:06:17.325561 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:06:17.325561 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: 0aa5b198f4e14d52a369248f1e6c0f47 Aug 30 01:06:17.325561 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-TestMinimumBasicScenario-34717424-project Aug 30 01:06:17.325561 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:06:17.325561 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Instance 5598be2a-00db-4303-bc81-a7fb3674e371 is not attached to volume b5d52ff1-2b30-4129-88db-4c1c9eb24be7 Aug 30 01:06:17.326342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'server_id': '5598be2a-00db-4303-bc81-a7fb3674e371', 'id': 'b5d52ff1-2b30-4129-88db-4c1c9eb24be7'} Aug 30 01:06:17.326342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:06:17.326342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:17.326342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 01:06:17.326342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 01:06:17.326342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:06:17.326342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:06:17.326342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 01:06:17.326342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 01:06:17.326342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b5d52ff1-2b30-4129-88db-4c1c9eb24be7. Aug 30 01:06:17.326342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:17.326342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:17.326342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:17.326342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:17.326342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:17.326342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:17.326342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:06:17.326342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:06:17.326342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:06:17.327653 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:06:17.327653 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 01:06:17.327653 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 01:06:17.327653 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5598be2a-00db-4303-bc81-a7fb3674e371 is not attached to volume b5d52ff1-2b30-4129-88db-4c1c9eb24be7 Aug 30 01:06:17.327653 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:17.327653 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:17.327653 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:17.327653 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:17.327653 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:17.327653 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:17.327653 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:06:17.327653 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:06:17.327653 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5598be2a-00db-4303-bc81-a7fb3674e371 is not attached to volume b5d52ff1-2b30-4129-88db-4c1c9eb24be7 Aug 30 01:06:17.327653 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:17.327653 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-b5ce6de3-393a-4cb9-b707-84c53b8ed026 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Returning 404 to user: Instance 5598be2a-00db-4303-bc81-a7fb3674e371 is not attached to volume b5d52ff1-2b30-4129-88db-4c1c9eb24be7 {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:06:17.328685 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-b5ce6de3-393a-4cb9-b707-84c53b8ed026 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371/os-volume_attachments/b5d52ff1-2b30-4129-88db-4c1c9eb24be7" status: 404 len: 154 microversion: 2.1 time: 0.094759 Aug 30 01:06:17.328685 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 279/570] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 30 01:06:17 2022] DELETE /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371/os-volume_attachments/b5d52ff1-2b30-4129-88db-4c1c9eb24be7 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:06:18.235999 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-da9914ab-abe1-46fa-807a-37ff18adf0b3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:18.236612 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-da9914ab-abe1-46fa-807a-37ff18adf0b3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:18.243237 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-da9914ab-abe1-46fa-807a-37ff18adf0b3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:18.243723 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-da9914ab-abe1-46fa-807a-37ff18adf0b3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:18.244160 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-da9914ab-abe1-46fa-807a-37ff18adf0b3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:18.244857 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-da9914ab-abe1-46fa-807a-37ff18adf0b3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:18.245337 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-da9914ab-abe1-46fa-807a-37ff18adf0b3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:18.245771 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-da9914ab-abe1-46fa-807a-37ff18adf0b3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:18.277515 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-d2840263-faf8-49fc-bf37-b5d6a771676c tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:18.279973 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-d2840263-faf8-49fc-bf37-b5d6a771676c tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:18.288037 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d2840263-faf8-49fc-bf37-b5d6a771676c tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:18.288519 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d2840263-faf8-49fc-bf37-b5d6a771676c tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:18.288952 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d2840263-faf8-49fc-bf37-b5d6a771676c tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:18.289673 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d2840263-faf8-49fc-bf37-b5d6a771676c tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:18.290221 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d2840263-faf8-49fc-bf37-b5d6a771676c tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:18.290647 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d2840263-faf8-49fc-bf37-b5d6a771676c tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:18.320212 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-d2840263-faf8-49fc-bf37-b5d6a771676c tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046685 Aug 30 01:06:18.320765 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 280/571] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:06:18 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:18.384309 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-da9914ab-abe1-46fa-807a-37ff18adf0b3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:18.392955 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-da9914ab-abe1-46fa-807a-37ff18adf0b3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1669 microversion: 2.1 time: 0.161410 Aug 30 01:06:18.393553 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 292/572] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:18 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:18.465147 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-f070aeef-e30b-48e5-a411-422a5a49c9eb tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:18.465737 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-f070aeef-e30b-48e5-a411-422a5a49c9eb tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:18.471735 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f070aeef-e30b-48e5-a411-422a5a49c9eb tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:18.472213 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f070aeef-e30b-48e5-a411-422a5a49c9eb tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:18.472646 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f070aeef-e30b-48e5-a411-422a5a49c9eb tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:18.473363 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f070aeef-e30b-48e5-a411-422a5a49c9eb tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:18.473814 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f070aeef-e30b-48e5-a411-422a5a49c9eb tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:18.474237 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f070aeef-e30b-48e5-a411-422a5a49c9eb tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:18.499005 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-f070aeef-e30b-48e5-a411-422a5a49c9eb tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Going to try to terminate instance {{(pid=120631) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:06:18.574165 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-f070aeef-e30b-48e5-a411-422a5a49c9eb tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 204 len: 0 microversion: 2.1 time: 0.112664 Aug 30 01:06:18.574737 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 281/573] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:06:18 2022] DELETE /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:06:18.583825 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-a2487125-b108-410b-9d74-2b3026cc2fee tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:18.584498 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-a2487125-b108-410b-9d74-2b3026cc2fee tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:18.590372 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a2487125-b108-410b-9d74-2b3026cc2fee tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:18.590856 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a2487125-b108-410b-9d74-2b3026cc2fee tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:18.591293 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a2487125-b108-410b-9d74-2b3026cc2fee tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:18.591978 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a2487125-b108-410b-9d74-2b3026cc2fee tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:18.592433 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a2487125-b108-410b-9d74-2b3026cc2fee tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:18.592857 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a2487125-b108-410b-9d74-2b3026cc2fee tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:18.722475 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-a2487125-b108-410b-9d74-2b3026cc2fee tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:18.730172 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-a2487125-b108-410b-9d74-2b3026cc2fee tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1554 microversion: 2.1 time: 0.150243 Aug 30 01:06:18.730733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 293/574] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:18 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:19.333691 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-854fa9a5-b9d6-43cc-80fa-056eb0840632 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:19.335966 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-854fa9a5-b9d6-43cc-80fa-056eb0840632 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:19.343214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-854fa9a5-b9d6-43cc-80fa-056eb0840632 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:19.343698 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-854fa9a5-b9d6-43cc-80fa-056eb0840632 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:19.344139 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-854fa9a5-b9d6-43cc-80fa-056eb0840632 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:19.344924 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-854fa9a5-b9d6-43cc-80fa-056eb0840632 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:19.345413 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-854fa9a5-b9d6-43cc-80fa-056eb0840632 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:19.345847 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-854fa9a5-b9d6-43cc-80fa-056eb0840632 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:19.377823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-854fa9a5-b9d6-43cc-80fa-056eb0840632 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048539 Aug 30 01:06:19.378383 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 282/575] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:06:19 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:19.414825 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-7f729004-4be3-485c-bb8c-a8628f8dc748 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:19.415509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-7f729004-4be3-485c-bb8c-a8628f8dc748 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:19.422885 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7f729004-4be3-485c-bb8c-a8628f8dc748 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:19.423377 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7f729004-4be3-485c-bb8c-a8628f8dc748 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:19.423812 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7f729004-4be3-485c-bb8c-a8628f8dc748 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:19.424509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7f729004-4be3-485c-bb8c-a8628f8dc748 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:19.424968 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7f729004-4be3-485c-bb8c-a8628f8dc748 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:19.425445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7f729004-4be3-485c-bb8c-a8628f8dc748 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:19.556513 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7f729004-4be3-485c-bb8c-a8628f8dc748 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:19.564814 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-7f729004-4be3-485c-bb8c-a8628f8dc748 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1669 microversion: 2.1 time: 0.153969 Aug 30 01:06:19.565408 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 294/576] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:19 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:19.752150 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-22167324-6458-4acd-9ab5-0a1ed3e08282 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:19.752735 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-22167324-6458-4acd-9ab5-0a1ed3e08282 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:19.759300 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-22167324-6458-4acd-9ab5-0a1ed3e08282 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:19.759782 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-22167324-6458-4acd-9ab5-0a1ed3e08282 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:19.760215 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-22167324-6458-4acd-9ab5-0a1ed3e08282 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:19.760893 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-22167324-6458-4acd-9ab5-0a1ed3e08282 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:19.761366 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-22167324-6458-4acd-9ab5-0a1ed3e08282 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:19.761785 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-22167324-6458-4acd-9ab5-0a1ed3e08282 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:19.889057 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-22167324-6458-4acd-9ab5-0a1ed3e08282 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:19.896758 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-22167324-6458-4acd-9ab5-0a1ed3e08282 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1554 microversion: 2.1 time: 0.148617 Aug 30 01:06:19.897353 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 283/577] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:19 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:20.389806 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-a4499d50-b79b-4c6e-b8ca-3c48232b5090 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:20.392066 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-a4499d50-b79b-4c6e-b8ca-3c48232b5090 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:20.398020 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a4499d50-b79b-4c6e-b8ca-3c48232b5090 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:20.398500 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a4499d50-b79b-4c6e-b8ca-3c48232b5090 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:20.398925 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a4499d50-b79b-4c6e-b8ca-3c48232b5090 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:20.399602 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a4499d50-b79b-4c6e-b8ca-3c48232b5090 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:20.400048 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a4499d50-b79b-4c6e-b8ca-3c48232b5090 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:20.400467 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a4499d50-b79b-4c6e-b8ca-3c48232b5090 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:20.430253 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-a4499d50-b79b-4c6e-b8ca-3c48232b5090 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044316 Aug 30 01:06:20.430830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 295/578] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:06:20 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:20.585753 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-f388e79d-50b1-4c9a-827a-2b0b276a905b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:20.586383 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-f388e79d-50b1-4c9a-827a-2b0b276a905b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:20.592759 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f388e79d-50b1-4c9a-827a-2b0b276a905b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:20.593284 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f388e79d-50b1-4c9a-827a-2b0b276a905b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:20.594287 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f388e79d-50b1-4c9a-827a-2b0b276a905b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:20.594972 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f388e79d-50b1-4c9a-827a-2b0b276a905b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:20.595419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f388e79d-50b1-4c9a-827a-2b0b276a905b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:20.595836 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f388e79d-50b1-4c9a-827a-2b0b276a905b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:20.729880 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-f388e79d-50b1-4c9a-827a-2b0b276a905b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:20.738518 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-f388e79d-50b1-4c9a-827a-2b0b276a905b tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1669 microversion: 2.1 time: 0.156558 Aug 30 01:06:20.739085 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 284/579] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:20 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:20.918381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-2cb40710-652b-41ee-a5c2-8a6685217043 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:20.918989 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-2cb40710-652b-41ee-a5c2-8a6685217043 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:20.925648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2cb40710-652b-41ee-a5c2-8a6685217043 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:20.926124 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2cb40710-652b-41ee-a5c2-8a6685217043 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:20.926554 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2cb40710-652b-41ee-a5c2-8a6685217043 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:20.927228 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2cb40710-652b-41ee-a5c2-8a6685217043 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:20.927675 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2cb40710-652b-41ee-a5c2-8a6685217043 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:20.928098 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2cb40710-652b-41ee-a5c2-8a6685217043 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:21.056423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-2cb40710-652b-41ee-a5c2-8a6685217043 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:21.064035 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-2cb40710-652b-41ee-a5c2-8a6685217043 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1554 microversion: 2.1 time: 0.149541 Aug 30 01:06:21.064605 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 296/580] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:20 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:21.505167 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-1f47b46f-a941-47b2-a425-5054ac0ac2c5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:21.507845 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-1f47b46f-a941-47b2-a425-5054ac0ac2c5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:21.514365 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f47b46f-a941-47b2-a425-5054ac0ac2c5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:21.514923 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f47b46f-a941-47b2-a425-5054ac0ac2c5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:21.515410 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f47b46f-a941-47b2-a425-5054ac0ac2c5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:21.516733 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f47b46f-a941-47b2-a425-5054ac0ac2c5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:21.517248 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f47b46f-a941-47b2-a425-5054ac0ac2c5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:21.517804 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f47b46f-a941-47b2-a425-5054ac0ac2c5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:21.539784 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:21.566942 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-1f47b46f-a941-47b2-a425-5054ac0ac2c5 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128232 Aug 30 01:06:21.567569 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 285/581] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:06:21 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:21.759621 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4e5816fd-6a30-472c-a855-4edf0a8fee39 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:21.760843 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-4e5816fd-6a30-472c-a855-4edf0a8fee39 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:21.770247 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4e5816fd-6a30-472c-a855-4edf0a8fee39 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:21.771854 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4e5816fd-6a30-472c-a855-4edf0a8fee39 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:21.772741 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4e5816fd-6a30-472c-a855-4edf0a8fee39 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:21.773659 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4e5816fd-6a30-472c-a855-4edf0a8fee39 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:21.774674 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4e5816fd-6a30-472c-a855-4edf0a8fee39 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:21.775163 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4e5816fd-6a30-472c-a855-4edf0a8fee39 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:21.993595 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-4e5816fd-6a30-472c-a855-4edf0a8fee39 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:22.007221 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-4e5816fd-6a30-472c-a855-4edf0a8fee39 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1669 microversion: 2.1 time: 0.251188 Aug 30 01:06:22.018615 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 297/582] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:21 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1669 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:22.042164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-ef20593e-8944-4ab6-9421-e23cb532956d req-04fdec71-8665-4922-8aa6-7caa7119f78b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5598be2a-00db-4303-bc81-a7fb3674e371", "name": "network-vif-deleted", "tag": "e2481fa1-2595-4100-98cf-07e796517813"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:22.066024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-ef20593e-8944-4ab6-9421-e23cb532956d req-04fdec71-8665-4922-8aa6-7caa7119f78b service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:22.067231 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-ef20593e-8944-4ab6-9421-e23cb532956d req-04fdec71-8665-4922-8aa6-7caa7119f78b service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:22.068060 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-ef20593e-8944-4ab6-9421-e23cb532956d req-04fdec71-8665-4922-8aa6-7caa7119f78b service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:22.086253 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-301ead29-147a-4397-adee-b2410d8cd057 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:22.086876 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-301ead29-147a-4397-adee-b2410d8cd057 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:22.092116 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-ef20593e-8944-4ab6-9421-e23cb532956d req-04fdec71-8665-4922-8aa6-7caa7119f78b service nova] Creating event network-vif-deleted:e2481fa1-2595-4100-98cf-07e796517813 for instance 5598be2a-00db-4303-bc81-a7fb3674e371 on hv-cinder-81514 Aug 30 01:06:22.097507 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-301ead29-147a-4397-adee-b2410d8cd057 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:22.097897 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-301ead29-147a-4397-adee-b2410d8cd057 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:22.099384 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-301ead29-147a-4397-adee-b2410d8cd057 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:22.100311 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-301ead29-147a-4397-adee-b2410d8cd057 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:22.100592 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-ef20593e-8944-4ab6-9421-e23cb532956d req-04fdec71-8665-4922-8aa6-7caa7119f78b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062168 Aug 30 01:06:22.100959 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-301ead29-147a-4397-adee-b2410d8cd057 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:22.101470 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-301ead29-147a-4397-adee-b2410d8cd057 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:22.101970 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 286/583] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:22.182940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-301ead29-147a-4397-adee-b2410d8cd057 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:22.193769 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-301ead29-147a-4397-adee-b2410d8cd057 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1343 microversion: 2.1 time: 0.112037 Aug 30 01:06:22.194705 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 298/584] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:22 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1343 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:22.355862 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-b29180b8-81ed-4d78-b060-a54f6e939038 req-63c4915b-fc52-435d-a290-cdbf57eb2610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59fedac-4fcb-47a8-8187-0a331d499fd2", "name": "network-vif-deleted", "tag": "26facd73-81ff-4a35-9126-739f3f31881b"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:22.368371 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-b29180b8-81ed-4d78-b060-a54f6e939038 req-63c4915b-fc52-435d-a290-cdbf57eb2610 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:22.369493 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-b29180b8-81ed-4d78-b060-a54f6e939038 req-63c4915b-fc52-435d-a290-cdbf57eb2610 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:22.370118 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-b29180b8-81ed-4d78-b060-a54f6e939038 req-63c4915b-fc52-435d-a290-cdbf57eb2610 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:22.383836 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-b29180b8-81ed-4d78-b060-a54f6e939038 req-63c4915b-fc52-435d-a290-cdbf57eb2610 service nova] Creating event network-vif-deleted:26facd73-81ff-4a35-9126-739f3f31881b for instance b59fedac-4fcb-47a8-8187-0a331d499fd2 on hv-cinder-81514 Aug 30 01:06:22.389474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-b29180b8-81ed-4d78-b060-a54f6e939038 req-63c4915b-fc52-435d-a290-cdbf57eb2610 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038622 Aug 30 01:06:22.394842 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 287/585] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:22.582332 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8d115ea6-31fb-4adc-bb08-af63e9c0637a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:22.586175 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8d115ea6-31fb-4adc-bb08-af63e9c0637a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:22.594140 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8d115ea6-31fb-4adc-bb08-af63e9c0637a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:22.594690 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8d115ea6-31fb-4adc-bb08-af63e9c0637a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:22.595322 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8d115ea6-31fb-4adc-bb08-af63e9c0637a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:22.596350 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8d115ea6-31fb-4adc-bb08-af63e9c0637a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:22.596806 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8d115ea6-31fb-4adc-bb08-af63e9c0637a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:22.597321 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8d115ea6-31fb-4adc-bb08-af63e9c0637a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:22.616435 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:22.634466 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8d115ea6-31fb-4adc-bb08-af63e9c0637a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058760 Aug 30 01:06:22.635042 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 299/586] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:06:22 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:06:22.697875 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-72874059-49ba-42f0-9769-cda5fa4833a4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:22.698645 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-72874059-49ba-42f0-9769-cda5fa4833a4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:22.705647 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-72874059-49ba-42f0-9769-cda5fa4833a4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:22.706297 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-72874059-49ba-42f0-9769-cda5fa4833a4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:22.706732 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-72874059-49ba-42f0-9769-cda5fa4833a4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:22.707419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-72874059-49ba-42f0-9769-cda5fa4833a4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:22.707865 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-72874059-49ba-42f0-9769-cda5fa4833a4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:22.708310 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-72874059-49ba-42f0-9769-cda5fa4833a4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:22.733796 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-72874059-49ba-42f0-9769-cda5fa4833a4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Going to try to terminate instance {{(pid=120631) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:06:22.813485 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-72874059-49ba-42f0-9769-cda5fa4833a4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325" status: 204 len: 0 microversion: 2.1 time: 0.119461 Aug 30 01:06:22.814242 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 288/587] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:06:22 2022] DELETE /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:06:22.822338 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-163412bc-56ec-493f-a7ee-0e601c74f036 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:22.823602 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-163412bc-56ec-493f-a7ee-0e601c74f036 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:22.831762 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-163412bc-56ec-493f-a7ee-0e601c74f036 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:22.833578 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-163412bc-56ec-493f-a7ee-0e601c74f036 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:22.834527 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-163412bc-56ec-493f-a7ee-0e601c74f036 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:22.835815 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-163412bc-56ec-493f-a7ee-0e601c74f036 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:22.836526 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-163412bc-56ec-493f-a7ee-0e601c74f036 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:22.838392 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-163412bc-56ec-493f-a7ee-0e601c74f036 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:22.974515 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-163412bc-56ec-493f-a7ee-0e601c74f036 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:22.982328 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-163412bc-56ec-493f-a7ee-0e601c74f036 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325" status: 200 len: 1680 microversion: 2.1 time: 0.163876 Aug 30 01:06:22.982902 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 300/588] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:22 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:23.033354 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-1d902046-0349-41d8-9df1-db9b04ebd32c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:23.034057 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-1d902046-0349-41d8-9df1-db9b04ebd32c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:23.040211 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1d902046-0349-41d8-9df1-db9b04ebd32c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:23.040684 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1d902046-0349-41d8-9df1-db9b04ebd32c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:23.041133 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1d902046-0349-41d8-9df1-db9b04ebd32c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:23.041817 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1d902046-0349-41d8-9df1-db9b04ebd32c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:23.042263 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1d902046-0349-41d8-9df1-db9b04ebd32c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:23.042815 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1d902046-0349-41d8-9df1-db9b04ebd32c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:23.077343 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1d902046-0349-41d8-9df1-db9b04ebd32c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:23.078355 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1d902046-0349-41d8-9df1-db9b04ebd32c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:23.078914 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1d902046-0349-41d8-9df1-db9b04ebd32c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:23.079357 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.objects.instance [None req-1d902046-0349-41d8-9df1-db9b04ebd32c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lazy-loading 'fault' on Instance uuid b59fedac-4fcb-47a8-8187-0a331d499fd2 {{(pid=120631) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:06:23.121565 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-1d902046-0349-41d8-9df1-db9b04ebd32c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:23.130112 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-1d902046-0349-41d8-9df1-db9b04ebd32c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1326 microversion: 2.1 time: 0.101129 Aug 30 01:06:23.130687 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 289/589] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:23 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1326 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:23.215932 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-cdfffcc5-be2c-407b-bbf6-cbea007d7186 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:23.216544 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-cdfffcc5-be2c-407b-bbf6-cbea007d7186 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:23.223818 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cdfffcc5-be2c-407b-bbf6-cbea007d7186 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:23.224308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cdfffcc5-be2c-407b-bbf6-cbea007d7186 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:23.224741 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cdfffcc5-be2c-407b-bbf6-cbea007d7186 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:23.225550 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cdfffcc5-be2c-407b-bbf6-cbea007d7186 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:23.226235 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cdfffcc5-be2c-407b-bbf6-cbea007d7186 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:23.226661 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cdfffcc5-be2c-407b-bbf6-cbea007d7186 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:23.259745 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cdfffcc5-be2c-407b-bbf6-cbea007d7186 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:23.260439 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cdfffcc5-be2c-407b-bbf6-cbea007d7186 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:23.260997 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cdfffcc5-be2c-407b-bbf6-cbea007d7186 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:23.261518 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.objects.instance [None req-cdfffcc5-be2c-407b-bbf6-cbea007d7186 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lazy-loading 'fault' on Instance uuid 5598be2a-00db-4303-bc81-a7fb3674e371 {{(pid=120630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:06:23.305227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-cdfffcc5-be2c-407b-bbf6-cbea007d7186 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:23.313122 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-cdfffcc5-be2c-407b-bbf6-cbea007d7186 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1348 microversion: 2.1 time: 0.101057 Aug 30 01:06:23.313700 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 301/590] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:23 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1348 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:24.004128 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-7b48e690-5c75-47fd-990c-df97629fa855 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:24.004739 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-7b48e690-5c75-47fd-990c-df97629fa855 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:24.010684 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7b48e690-5c75-47fd-990c-df97629fa855 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:24.011197 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7b48e690-5c75-47fd-990c-df97629fa855 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:24.011629 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7b48e690-5c75-47fd-990c-df97629fa855 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:24.012305 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7b48e690-5c75-47fd-990c-df97629fa855 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:24.012749 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7b48e690-5c75-47fd-990c-df97629fa855 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:24.013195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7b48e690-5c75-47fd-990c-df97629fa855 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:24.147444 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-7b48e690-5c75-47fd-990c-df97629fa855 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:24.154638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-0cc6aadf-e321-42e7-aaba-89f6e1f06dbc tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:24.155126 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-7b48e690-5c75-47fd-990c-df97629fa855 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325" status: 200 len: 1680 microversion: 2.1 time: 0.155501 Aug 30 01:06:24.155251 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-0cc6aadf-e321-42e7-aaba-89f6e1f06dbc tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:24.155683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 290/591] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:23 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:24.163117 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0cc6aadf-e321-42e7-aaba-89f6e1f06dbc tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:24.163598 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0cc6aadf-e321-42e7-aaba-89f6e1f06dbc tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:24.164029 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0cc6aadf-e321-42e7-aaba-89f6e1f06dbc tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:24.164719 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0cc6aadf-e321-42e7-aaba-89f6e1f06dbc tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:24.165189 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0cc6aadf-e321-42e7-aaba-89f6e1f06dbc tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:24.165612 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0cc6aadf-e321-42e7-aaba-89f6e1f06dbc tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:24.198299 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0cc6aadf-e321-42e7-aaba-89f6e1f06dbc tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:24.198776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0cc6aadf-e321-42e7-aaba-89f6e1f06dbc tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:24.199207 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0cc6aadf-e321-42e7-aaba-89f6e1f06dbc tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:24.199645 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.objects.instance [None req-0cc6aadf-e321-42e7-aaba-89f6e1f06dbc tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lazy-loading 'fault' on Instance uuid b59fedac-4fcb-47a8-8187-0a331d499fd2 {{(pid=120630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:06:24.243838 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-0cc6aadf-e321-42e7-aaba-89f6e1f06dbc tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:24.252533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-0cc6aadf-e321-42e7-aaba-89f6e1f06dbc tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 200 len: 1326 microversion: 2.1 time: 0.101493 Aug 30 01:06:24.253130 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 302/592] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:24 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 1326 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:06:24.334505 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-7d8d95aa-c3ae-4627-bec3-a8ed32038925 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:24.335282 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-7d8d95aa-c3ae-4627-bec3-a8ed32038925 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:24.342379 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7d8d95aa-c3ae-4627-bec3-a8ed32038925 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:24.342876 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7d8d95aa-c3ae-4627-bec3-a8ed32038925 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:24.343884 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7d8d95aa-c3ae-4627-bec3-a8ed32038925 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:24.344993 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7d8d95aa-c3ae-4627-bec3-a8ed32038925 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:24.345660 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7d8d95aa-c3ae-4627-bec3-a8ed32038925 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:24.346244 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7d8d95aa-c3ae-4627-bec3-a8ed32038925 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:24.378656 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7d8d95aa-c3ae-4627-bec3-a8ed32038925 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:24.379131 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7d8d95aa-c3ae-4627-bec3-a8ed32038925 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:24.379563 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7d8d95aa-c3ae-4627-bec3-a8ed32038925 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:24.380008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.objects.instance [None req-7d8d95aa-c3ae-4627-bec3-a8ed32038925 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lazy-loading 'fault' on Instance uuid 5598be2a-00db-4303-bc81-a7fb3674e371 {{(pid=120631) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:06:24.419596 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-7d8d95aa-c3ae-4627-bec3-a8ed32038925 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa5b198f4e14d52a369248f1e6c0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43fd867154911badb413c7046befd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:24.427836 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-7d8d95aa-c3ae-4627-bec3-a8ed32038925 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 200 len: 1348 microversion: 2.1 time: 0.097456 Aug 30 01:06:24.428654 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 291/593] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:24 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:25.182591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-9e3cc989-7711-4a51-8ed1-4fc8365e6d22 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:25.183890 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-9e3cc989-7711-4a51-8ed1-4fc8365e6d22 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:25.192404 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9e3cc989-7711-4a51-8ed1-4fc8365e6d22 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:25.192890 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9e3cc989-7711-4a51-8ed1-4fc8365e6d22 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:25.193367 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9e3cc989-7711-4a51-8ed1-4fc8365e6d22 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:25.194061 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9e3cc989-7711-4a51-8ed1-4fc8365e6d22 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:25.194512 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9e3cc989-7711-4a51-8ed1-4fc8365e6d22 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:25.194937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-9e3cc989-7711-4a51-8ed1-4fc8365e6d22 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:25.275038 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-355320cd-9a83-474a-a26f-e3852925986a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:25.275642 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-355320cd-9a83-474a-a26f-e3852925986a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:25.284059 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-355320cd-9a83-474a-a26f-e3852925986a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:25.285066 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-355320cd-9a83-474a-a26f-e3852925986a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:25.285533 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-355320cd-9a83-474a-a26f-e3852925986a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:25.286379 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-355320cd-9a83-474a-a26f-e3852925986a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:25.286979 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-355320cd-9a83-474a-a26f-e3852925986a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:25.287552 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-355320cd-9a83-474a-a26f-e3852925986a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:25.302866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-355320cd-9a83-474a-a26f-e3852925986a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] HTTP exception thrown: Instance b59fedac-4fcb-47a8-8187-0a331d499fd2 could not be found. Aug 30 01:06:25.304915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-355320cd-9a83-474a-a26f-e3852925986a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Request method failure captured: Aug 30 01:06:25.304915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 HTTP/1.1 Aug 30 01:06:25.304915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:06:25.304915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:06:25.304915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:06:25.304915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:06:25.304915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:06:25.304915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:06:25.304915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:06:25.304915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:06:25.304915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWFdvGLGGrrzeBRj1xCnzWHvxtL2jI7lW1boDKifREfYH0T80DE0HQj1uxS2XHMB3h7wUIsW8tHd958F2-_vvvA-XoRij44TrLoTFedHOEbOxJ0RQoSO1UK0ktOb3rcbW4EdIMG8DRpVyK6sJGj07FacPpoWxGKqUZmdj_JYlTyAnHk Aug 30 01:06:25.304915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:06:25.304915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:06:25.304915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:06:25.304915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:06:25.304915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:06:25.304915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:06:25.304915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: f40b3e29a18b48cba6800c9f3a0dfee9 Aug 30 01:06:25.304915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-AttachVolumeTestJSON-936502140 Aug 30 01:06:25.304915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:06:25.304915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:06:25.306419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f40b3e29a18b48cba6800c9f3a0dfee9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f40b3e29a18b48cba6800c9f3a0dfee9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f40b3e29a18b48cba6800c9f3a0dfee9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f40b3e29a18b48cba6800c9f3a0dfee9"}]}] Aug 30 01:06:25.306419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-AttachVolumeTestJSON-936502140 Aug 30 01:06:25.306419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: f40b3e29a18b48cba6800c9f3a0dfee9 Aug 30 01:06:25.306419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-AttachVolumeTestJSON-936502140 Aug 30 01:06:25.306419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-AttachVolumeTestJSON-936502140-project Aug 30 01:06:25.306419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:06:25.306419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:06:25.306419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: c6fe0e0033de447da70be9bc0228eba2 Aug 30 01:06:25.306419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-AttachVolumeTestJSON-936502140-project Aug 30 01:06:25.306419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:06:25.306419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Instance b59fedac-4fcb-47a8-8187-0a331d499fd2 could not be found. Aug 30 01:06:25.306419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': 'b59fedac-4fcb-47a8-8187-0a331d499fd2'} Aug 30 01:06:25.307321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:06:25.307321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:25.307321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:06:25.307321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:06:25.307321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:06:25.307321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:06:25.307321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:06:25.307321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:06:25.307321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:06:25.307321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:06:25.307321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b59fedac-4fcb-47a8-8187-0a331d499fd2 could not be found. Aug 30 01:06:25.307321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:25.307321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:25.307321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:25.307321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:25.307321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:25.307321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:25.307321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:06:25.307321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:06:25.307321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:06:25.308723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:06:25.308723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:06:25.308723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:06:25.308723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:06:25.308723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:06:25.308723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:06:25.308723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:06:25.308723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b59fedac-4fcb-47a8-8187-0a331d499fd2 could not be found. Aug 30 01:06:25.308723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:25.308723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:25.308723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:25.308723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:25.308723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:25.308723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:25.308723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:06:25.308723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:06:25.308723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b59fedac-4fcb-47a8-8187-0a331d499fd2 could not be found. Aug 30 01:06:25.308723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:25.310843 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-355320cd-9a83-474a-a26f-e3852925986a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Returning 404 to user: Instance b59fedac-4fcb-47a8-8187-0a331d499fd2 could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:06:25.311871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-355320cd-9a83-474a-a26f-e3852925986a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 404 len: 111 microversion: 2.1 time: 0.041829 Aug 30 01:06:25.316540 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 292/594] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:25 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:06:25.321457 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-2120b1e4-aa3e-45a6-b40f-f05c9124ae4a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '.version_select at 0x7f0f53ff2430>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:25.335711 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-9e3cc989-7711-4a51-8ed1-4fc8365e6d22 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:25.346623 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-2120b1e4-aa3e-45a6-b40f-f05c9124ae4a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-751847141" status: 202 len: 0 microversion: 2.1 time: 0.028681 Aug 30 01:06:25.347588 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 293/595] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Aug 30 01:06:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-751847141 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:06:25.347970 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-9e3cc989-7711-4a51-8ed1-4fc8365e6d22 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325" status: 200 len: 1680 microversion: 2.1 time: 0.172758 Aug 30 01:06:25.361453 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 303/596] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:25 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:25.449272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-786d425c-0ec2-41c2-ad09-94eeb6e59a40 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:25.450159 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-786d425c-0ec2-41c2-ad09-94eeb6e59a40 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] [instance: 5598be2a-00db-4303-bc81-a7fb3674e371] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:25.458063 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-786d425c-0ec2-41c2-ad09-94eeb6e59a40 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:25.458667 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-786d425c-0ec2-41c2-ad09-94eeb6e59a40 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:25.459170 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-786d425c-0ec2-41c2-ad09-94eeb6e59a40 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:25.460084 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-786d425c-0ec2-41c2-ad09-94eeb6e59a40 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:25.460745 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-786d425c-0ec2-41c2-ad09-94eeb6e59a40 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:25.461282 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-786d425c-0ec2-41c2-ad09-94eeb6e59a40 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:25.477333 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-786d425c-0ec2-41c2-ad09-94eeb6e59a40 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] HTTP exception thrown: Instance 5598be2a-00db-4303-bc81-a7fb3674e371 could not be found. Aug 30 01:06:25.479109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-786d425c-0ec2-41c2-ad09-94eeb6e59a40 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Request method failure captured: Aug 30 01:06:25.479109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 HTTP/1.1 Aug 30 01:06:25.479109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:06:25.479109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:06:25.479109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:06:25.479109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:06:25.479109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:06:25.479109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:06:25.479109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:06:25.479109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:06:25.479109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWHXeVUbhjvamuZZtlAp8qv6ZRt7Z_qVtslvX5p0lzqsanFq_t2lf1W077EVrNmAUaL2pT4Ow-jSi7ncPOQ_cFhszvRcQPKuCa_tItvTvMZpSaoEsJ_j88EXIs0XZqmyCw94S_q8s93AWYvHAraEt-iZ927EJrAo0cETpGu8WNyk4bo Aug 30 01:06:25.479109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:06:25.479109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:06:25.479109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:06:25.479109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:06:25.479109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:06:25.479109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:06:25.479109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: fca43fd867154911badb413c7046befd Aug 30 01:06:25.479109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-TestMinimumBasicScenario-34717424 Aug 30 01:06:25.479109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:06:25.479109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:06:25.480581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fca43fd867154911badb413c7046befd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fca43fd867154911badb413c7046befd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fca43fd867154911badb413c7046befd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fca43fd867154911badb413c7046befd"}]}] Aug 30 01:06:25.480581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-TestMinimumBasicScenario-34717424 Aug 30 01:06:25.480581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: fca43fd867154911badb413c7046befd Aug 30 01:06:25.480581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-TestMinimumBasicScenario-34717424 Aug 30 01:06:25.480581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-TestMinimumBasicScenario-34717424-project Aug 30 01:06:25.480581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:06:25.480581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:06:25.480581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: 0aa5b198f4e14d52a369248f1e6c0f47 Aug 30 01:06:25.480581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-TestMinimumBasicScenario-34717424-project Aug 30 01:06:25.480581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:06:25.480581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Instance 5598be2a-00db-4303-bc81-a7fb3674e371 could not be found. Aug 30 01:06:25.480581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': '5598be2a-00db-4303-bc81-a7fb3674e371'} Aug 30 01:06:25.481416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:06:25.481416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:25.481416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:06:25.481416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:06:25.481416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:06:25.481416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:06:25.481416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:06:25.481416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:06:25.481416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:06:25.481416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:06:25.481416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5598be2a-00db-4303-bc81-a7fb3674e371 could not be found. Aug 30 01:06:25.481416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:25.481416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:25.481416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:25.481416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:25.481416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:25.481416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:25.481416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:06:25.481416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:06:25.481416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:06:25.482770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:06:25.482770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:06:25.482770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:06:25.482770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:06:25.482770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:06:25.482770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:06:25.482770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:06:25.482770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5598be2a-00db-4303-bc81-a7fb3674e371 could not be found. Aug 30 01:06:25.482770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:25.482770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:25.482770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:25.482770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:25.482770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:25.482770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:25.482770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:06:25.482770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:06:25.482770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5598be2a-00db-4303-bc81-a7fb3674e371 could not be found. Aug 30 01:06:25.482770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:25.484664 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-786d425c-0ec2-41c2-ad09-94eeb6e59a40 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Returning 404 to user: Instance 5598be2a-00db-4303-bc81-a7fb3674e371 could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:06:25.484664 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-786d425c-0ec2-41c2-ad09-94eeb6e59a40 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371" status: 404 len: 111 microversion: 2.1 time: 0.035502 Aug 30 01:06:25.484664 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 294/597] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:25 2022] GET /compute/v2.1/servers/5598be2a-00db-4303-bc81-a7fb3674e371 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:06:25.490360 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-e0844e07-5dd3-4b55-8ff5-ff831f44f7b4 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] Calling method '.version_select at 0x7f0f525cd8b0>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:25.512575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-e0844e07-5dd3-4b55-8ff5-ff831f44f7b4 tempest-TestMinimumBasicScenario-34717424 tempest-TestMinimumBasicScenario-34717424-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-569795229" status: 202 len: 0 microversion: 2.1 time: 0.025857 Aug 30 01:06:25.513362 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 304/598] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Aug 30 01:06:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-569795229 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:06:25.668294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-0d77fc85-9db5-4537-9b34-ce33d767cb2f req-b65b7f35-5610-48c4-b716-cb323ce5f73c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af1febc-f5f3-440d-ab4b-0e33ac174325", "name": "network-vif-deleted", "tag": "b0dd4618-5f7f-4366-b8dd-3fb92df6a2c1"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:25.684151 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-0d77fc85-9db5-4537-9b34-ce33d767cb2f req-b65b7f35-5610-48c4-b716-cb323ce5f73c service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:25.685162 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-0d77fc85-9db5-4537-9b34-ce33d767cb2f req-b65b7f35-5610-48c4-b716-cb323ce5f73c service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:25.685923 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-0d77fc85-9db5-4537-9b34-ce33d767cb2f req-b65b7f35-5610-48c4-b716-cb323ce5f73c service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:25.716695 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-0d77fc85-9db5-4537-9b34-ce33d767cb2f req-b65b7f35-5610-48c4-b716-cb323ce5f73c service nova] Creating event network-vif-deleted:b0dd4618-5f7f-4366-b8dd-3fb92df6a2c1 for instance 4af1febc-f5f3-440d-ab4b-0e33ac174325 on hv-cinder-81514 Aug 30 01:06:25.727835 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-0d77fc85-9db5-4537-9b34-ce33d767cb2f req-b65b7f35-5610-48c4-b716-cb323ce5f73c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063238 Aug 30 01:06:25.733103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 295/599] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:26.151820 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-1f6a884e-d08a-4401-a27d-3b68efe949b9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Action: 'create', calling method: .version_select at 0x7f0f52846c10>, body: {"keypair": {"name": "tempest-keypair-1716051925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwjLPgIxIPfNra5mWqSz/vDne77AEnKAkOHW+RAZNDr2IhXADJLokZ+vPZbd5iUoSmQdrkKKNhrqQSm0C+blrMnKJNAZ4bB0lPlUERPiJUHKxNeyR8fklebujt5/M1wNw=="}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:26.171962 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-1f6a884e-d08a-4401-a27d-3b68efe949b9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Getting quotas for project f40b3e29a18b48cba6800c9f3a0dfee9. Resources: {'key_pairs'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:06:26.177526 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-1f6a884e-d08a-4401-a27d-3b68efe949b9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Getting quotas for user c6fe0e0033de447da70be9bc0228eba2 and project f40b3e29a18b48cba6800c9f3a0dfee9. Resources: {'key_pairs'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:06:26.207254 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-1f6a884e-d08a-4401-a27d-3b68efe949b9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059526 Aug 30 01:06:26.207905 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 305/600] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 30 01:06:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:26.376413 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-56c4f768-9875-46c4-a3e7-7d3f27121db7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:26.377188 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-56c4f768-9875-46c4-a3e7-7d3f27121db7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:26.388811 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-56c4f768-9875-46c4-a3e7-7d3f27121db7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:26.389328 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-56c4f768-9875-46c4-a3e7-7d3f27121db7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:26.389764 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-56c4f768-9875-46c4-a3e7-7d3f27121db7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:26.391052 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-56c4f768-9875-46c4-a3e7-7d3f27121db7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:26.391506 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-56c4f768-9875-46c4-a3e7-7d3f27121db7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:26.392001 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-56c4f768-9875-46c4-a3e7-7d3f27121db7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:26.434001 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-56c4f768-9875-46c4-a3e7-7d3f27121db7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:26.434988 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-56c4f768-9875-46c4-a3e7-7d3f27121db7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:26.435684 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-56c4f768-9875-46c4-a3e7-7d3f27121db7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:26.436742 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.objects.instance [None req-56c4f768-9875-46c4-a3e7-7d3f27121db7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lazy-loading 'fault' on Instance uuid 4af1febc-f5f3-440d-ab4b-0e33ac174325 {{(pid=120631) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:06:26.519991 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-56c4f768-9875-46c4-a3e7-7d3f27121db7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:26.534378 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-56c4f768-9875-46c4-a3e7-7d3f27121db7 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325" status: 200 len: 1331 microversion: 2.1 time: 0.163381 Aug 30 01:06:26.536192 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 296/601] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:26 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325 => generated 1331 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:27.561039 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-202803f3-b1ea-4c19-9595-194a66b7be62 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:27.563088 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-202803f3-b1ea-4c19-9595-194a66b7be62 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:27.570035 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-202803f3-b1ea-4c19-9595-194a66b7be62 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:27.570780 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-202803f3-b1ea-4c19-9595-194a66b7be62 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:27.571215 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-202803f3-b1ea-4c19-9595-194a66b7be62 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:27.572241 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-202803f3-b1ea-4c19-9595-194a66b7be62 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:27.572702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-202803f3-b1ea-4c19-9595-194a66b7be62 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:27.573157 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-202803f3-b1ea-4c19-9595-194a66b7be62 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:27.585404 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-8e180a33-7981-4aeb-a6c5-e5befa0b3955 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1105776450", "imageRef": "d6c817b5-c41c-4210-a963-172386e2e582", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b956883-0f29-4de3-9788-00541616d922"}], "security_groups": [{"name": "tempest-securitygroup--2099084934"}], "key_name": "tempest-keypair-1716051925", "user_data": "}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:27.589759 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-202803f3-b1ea-4c19-9595-194a66b7be62 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] HTTP exception thrown: Instance 4af1febc-f5f3-440d-ab4b-0e33ac174325 could not be found. Aug 30 01:06:27.591594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-202803f3-b1ea-4c19-9595-194a66b7be62 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Request method failure captured: Aug 30 01:06:27.591594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325 HTTP/1.1 Aug 30 01:06:27.591594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:06:27.591594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:06:27.591594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:06:27.591594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:06:27.591594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:06:27.591594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:06:27.591594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:06:27.591594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:06:27.591594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWFfZmUwgQ0mFuieojBsvktSnruxexkMD8R8bd6MnZKGHmPnXPTUGPvemFUgtcXUu8u-yzCNpJULMfiAasm8f-KjX-nH3CChWEIyCAavljtkV9ICnALTHbbll4hz4f_VNsMQOGGKv1XAa5uQHI8I8bGS718FQfoeBt-22Hj_CVvvdxo Aug 30 01:06:27.591594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:06:27.591594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:06:27.591594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:06:27.591594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:06:27.591594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:06:27.591594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:06:27.591594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:06:27.591594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:06:27.591594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:06:27.591594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:06:27.593284 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0596692dbfb149139a1e72159c6f93db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}] Aug 30 01:06:27.593284 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:06:27.593284 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:06:27.593284 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:06:27.593284 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:06:27.593284 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:06:27.593284 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:06:27.593284 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: cc7cf306aadb45d1b65252b53c86b612 Aug 30 01:06:27.593284 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:06:27.593284 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:06:27.593284 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Instance 4af1febc-f5f3-440d-ab4b-0e33ac174325 could not be found. Aug 30 01:06:27.593284 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': '4af1febc-f5f3-440d-ab4b-0e33ac174325'} Aug 30 01:06:27.594249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:06:27.594249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:27.594249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:06:27.594249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:06:27.594249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:06:27.594249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:06:27.594249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:06:27.594249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:06:27.594249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:06:27.594249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:06:27.594249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4af1febc-f5f3-440d-ab4b-0e33ac174325 could not be found. Aug 30 01:06:27.594249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:06:27.594249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:27.594249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:06:27.594249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:27.594249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:27.594249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:27.594249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:06:27.594249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:06:27.594249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:06:27.595632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:06:27.595632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:06:27.595632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:06:27.595632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:06:27.595632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:06:27.595632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:06:27.595632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:06:27.595632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4af1febc-f5f3-440d-ab4b-0e33ac174325 could not be found. Aug 30 01:06:27.595632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:06:27.595632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:27.595632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:06:27.595632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:27.595632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:27.595632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:27.595632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:06:27.595632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:06:27.595632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4af1febc-f5f3-440d-ab4b-0e33ac174325 could not be found. Aug 30 01:06:27.595632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:06:27.596854 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-202803f3-b1ea-4c19-9595-194a66b7be62 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Returning 404 to user: Instance 4af1febc-f5f3-440d-ab4b-0e33ac174325 could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:06:27.596854 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-202803f3-b1ea-4c19-9595-194a66b7be62 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325" status: 404 len: 111 microversion: 2.1 time: 0.036148 Aug 30 01:06:27.596854 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 306/602] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:27 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:06:27.602890 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-60e30f3e-c534-4f54-935c-05b77795671d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '.version_select at 0x7f0f525a58b0>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:27.625649 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-60e30f3e-c534-4f54-935c-05b77795671d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1469346838" status: 202 len: 0 microversion: 2.1 time: 0.026472 Aug 30 01:06:27.626226 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 307/603] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Aug 30 01:06:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1469346838 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:06:27.733630 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.network.neutron [None req-8e180a33-7981-4aeb-a6c5-e5befa0b3955 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] validate_networks() for [('0b956883-0f29-4de3-9788-00541616d922', None, None, None, None, None)] {{(pid=120631) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:06:28.268655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-8e180a33-7981-4aeb-a6c5-e5befa0b3955 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Flavor limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:06:28.269111 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-8e180a33-7981-4aeb-a6c5-e5befa0b3955 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Image limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:06:28.269581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-8e180a33-7981-4aeb-a6c5-e5befa0b3955 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Flavor pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:06:28.269994 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-8e180a33-7981-4aeb-a6c5-e5befa0b3955 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Image pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:06:28.270406 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-8e180a33-7981-4aeb-a6c5-e5befa0b3955 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:06:28.279438 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8e180a33-7981-4aeb-a6c5-e5befa0b3955 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:28.279924 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8e180a33-7981-4aeb-a6c5-e5befa0b3955 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:28.280364 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8e180a33-7981-4aeb-a6c5-e5befa0b3955 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:28.281780 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8e180a33-7981-4aeb-a6c5-e5befa0b3955 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:28.282348 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8e180a33-7981-4aeb-a6c5-e5befa0b3955 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:28.282782 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8e180a33-7981-4aeb-a6c5-e5befa0b3955 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:28.300828 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-8e180a33-7981-4aeb-a6c5-e5befa0b3955 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Getting quotas for project f40b3e29a18b48cba6800c9f3a0dfee9. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:06:28.304701 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-8e180a33-7981-4aeb-a6c5-e5befa0b3955 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Getting quotas for user c6fe0e0033de447da70be9bc0228eba2 and project f40b3e29a18b48cba6800c9f3a0dfee9. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:06:28.315795 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-8e180a33-7981-4aeb-a6c5-e5befa0b3955 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Going to run 1 instances... {{(pid=120631) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:06:28.318125 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-8e180a33-7981-4aeb-a6c5-e5befa0b3955 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6c817b5-c41c-4210-a963-172386e2e582',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120631) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:06:28.365047 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-8e180a33-7981-4aeb-a6c5-e5befa0b3955 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.783858 Aug 30 01:06:28.366061 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 297/604] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 30 01:06:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:06:28.376856 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-fba6a1b5-8b3b-4573-922c-327ff6bb0b14 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:28.377610 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-fba6a1b5-8b3b-4573-922c-327ff6bb0b14 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:28.435776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-fba6a1b5-8b3b-4573-922c-327ff6bb0b14 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:28.443815 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-fba6a1b5-8b3b-4573-922c-327ff6bb0b14 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7" status: 200 len: 1238 microversion: 2.1 time: 0.070751 Aug 30 01:06:28.458032 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 308/605] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:28 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:28.829676 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-8d53c1d0-463f-4dbc-9e38-4aa21c1feba9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Action: 'create', calling method: .version_select at 0x7f0f528d6af0>, body: {"keypair": {"name": "tempest-keypair-1122632298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2cMwwAHmpBR4P3xirl0foiOJHwH4t/Var+hqbyB3238epl9KOoQP/zrvQOmOHl948CMQ1gZLO+HPcZYBTWa1mzDzJ8lM9Ge9e/0zlPdB2h+QI82e0nXh9s4NKjjDCoZQ=="}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:28.852594 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-8d53c1d0-463f-4dbc-9e38-4aa21c1feba9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Getting quotas for project 0596692dbfb149139a1e72159c6f93db. Resources: {'key_pairs'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:06:28.858254 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-8d53c1d0-463f-4dbc-9e38-4aa21c1feba9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Getting quotas for user cc7cf306aadb45d1b65252b53c86b612 and project 0596692dbfb149139a1e72159c6f93db. Resources: {'key_pairs'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:06:28.879032 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:28.893963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-8d53c1d0-463f-4dbc-9e38-4aa21c1feba9 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070251 Aug 30 01:06:28.895149 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 298/606] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 30 01:06:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:29.466656 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-e73d8168-a886-4527-a1b6-a15af67db1e5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:29.467240 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-e73d8168-a886-4527-a1b6-a15af67db1e5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:29.475332 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e73d8168-a886-4527-a1b6-a15af67db1e5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:29.475821 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e73d8168-a886-4527-a1b6-a15af67db1e5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:29.476468 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e73d8168-a886-4527-a1b6-a15af67db1e5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:29.477441 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e73d8168-a886-4527-a1b6-a15af67db1e5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:29.478047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e73d8168-a886-4527-a1b6-a15af67db1e5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:29.478486 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e73d8168-a886-4527-a1b6-a15af67db1e5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:29.558769 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-e73d8168-a886-4527-a1b6-a15af67db1e5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:29.581000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-e73d8168-a886-4527-a1b6-a15af67db1e5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7" status: 200 len: 1290 microversion: 2.1 time: 0.117478 Aug 30 01:06:29.584019 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 309/607] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:29 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 => generated 1290 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:30.181325 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-63623faa-47de-41dd-a1ba-967be89fa379 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:30.182379 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-63623faa-47de-41dd-a1ba-967be89fa379 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:30.206937 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-63623faa-47de-41dd-a1ba-967be89fa379 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:30.207442 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-63623faa-47de-41dd-a1ba-967be89fa379 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:30.207888 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-63623faa-47de-41dd-a1ba-967be89fa379 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:30.208615 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-63623faa-47de-41dd-a1ba-967be89fa379 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:30.209105 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-63623faa-47de-41dd-a1ba-967be89fa379 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:30.209530 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-63623faa-47de-41dd-a1ba-967be89fa379 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:30.371198 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.objects.instance [None req-63623faa-47de-41dd-a1ba-967be89fa379 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lazy-loading 'services' on Instance uuid 2cff4036-ef80-4791-92b5-0c71c8e93582 {{(pid=120631) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:06:30.476602 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-63623faa-47de-41dd-a1ba-967be89fa379 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582/os-volume_attachments/52c36bad-005a-449a-a968-a61e36c0b72a" status: 202 len: 0 microversion: 2.1 time: 0.309767 Aug 30 01:06:30.477387 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 299/608] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 30 01:06:30 2022] DELETE /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582/os-volume_attachments/52c36bad-005a-449a-a968-a61e36c0b72a => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:06:30.487721 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-5d940548-5656-470c-ae0b-3564e4d3963e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:30.490492 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-5d940548-5656-470c-ae0b-3564e4d3963e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:30.497427 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5d940548-5656-470c-ae0b-3564e4d3963e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:30.498261 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5d940548-5656-470c-ae0b-3564e4d3963e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:30.498772 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5d940548-5656-470c-ae0b-3564e4d3963e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:30.499757 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5d940548-5656-470c-ae0b-3564e4d3963e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:30.500604 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5d940548-5656-470c-ae0b-3564e4d3963e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:30.501035 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5d940548-5656-470c-ae0b-3564e4d3963e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:30.580155 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-5d940548-5656-470c-ae0b-3564e4d3963e tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096497 Aug 30 01:06:30.587180 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 310/609] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:06:30 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:30.606033 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-29e727d8-87ee-48d0-9c2e-d18f39b84719 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:30.606737 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-29e727d8-87ee-48d0-9c2e-d18f39b84719 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:30.627552 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-29e727d8-87ee-48d0-9c2e-d18f39b84719 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:30.628055 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-29e727d8-87ee-48d0-9c2e-d18f39b84719 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:30.628493 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-29e727d8-87ee-48d0-9c2e-d18f39b84719 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:30.629238 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-29e727d8-87ee-48d0-9c2e-d18f39b84719 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:30.629709 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-29e727d8-87ee-48d0-9c2e-d18f39b84719 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:30.630121 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-29e727d8-87ee-48d0-9c2e-d18f39b84719 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:31.019930 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-29e727d8-87ee-48d0-9c2e-d18f39b84719 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:31.032984 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-29e727d8-87ee-48d0-9c2e-d18f39b84719 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7" status: 200 len: 1296 microversion: 2.1 time: 0.431036 Aug 30 01:06:31.035511 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 300/610] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:30 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 => generated 1296 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:31.595846 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-15cac0fc-764d-4b3b-be5d-9765be551a39 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:31.598157 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-15cac0fc-764d-4b3b-be5d-9765be551a39 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:31.604268 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-15cac0fc-764d-4b3b-be5d-9765be551a39 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:31.604749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-15cac0fc-764d-4b3b-be5d-9765be551a39 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:31.605201 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-15cac0fc-764d-4b3b-be5d-9765be551a39 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:31.605893 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-15cac0fc-764d-4b3b-be5d-9765be551a39 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:31.606340 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-15cac0fc-764d-4b3b-be5d-9765be551a39 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:31.606799 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-15cac0fc-764d-4b3b-be5d-9765be551a39 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:31.636426 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-15cac0fc-764d-4b3b-be5d-9765be551a39 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045141 Aug 30 01:06:31.637794 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 311/611] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:06:31 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:06:31.718401 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-ba1e33aa-c67d-4418-9246-4fb771dca789 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:31.719261 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-ba1e33aa-c67d-4418-9246-4fb771dca789 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:31.727140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ba1e33aa-c67d-4418-9246-4fb771dca789 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:31.727633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ba1e33aa-c67d-4418-9246-4fb771dca789 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:31.728074 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ba1e33aa-c67d-4418-9246-4fb771dca789 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:31.728782 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ba1e33aa-c67d-4418-9246-4fb771dca789 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:31.729277 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ba1e33aa-c67d-4418-9246-4fb771dca789 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:31.729708 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ba1e33aa-c67d-4418-9246-4fb771dca789 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:31.753509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-7084f9c1-a22b-4188-97e5-95d5874e443d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-578779543", "imageRef": "d6c817b5-c41c-4210-a963-172386e2e582", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dffca817-1d31-4c9c-99a3-2d8483c143b4"}], "security_groups": [{"name": "tempest-securitygroup--1732321140"}], "key_name": "tempest-keypair-1122632298", "user_data": "}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:31.757529 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-ba1e33aa-c67d-4418-9246-4fb771dca789 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Going to try to terminate instance {{(pid=120631) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:06:31.883025 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-ba1e33aa-c67d-4418-9246-4fb771dca789 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 204 len: 0 microversion: 2.1 time: 0.167531 Aug 30 01:06:31.895157 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 301/612] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:06:31 2022] DELETE /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:06:31.899699 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.network.neutron [None req-7084f9c1-a22b-4188-97e5-95d5874e443d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] validate_networks() for [('dffca817-1d31-4c9c-99a3-2d8483c143b4', None, None, None, None, None)] {{(pid=120630) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:06:31.904915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-8e455b1d-d107-449e-bb2e-df1cd97041a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:31.906614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-8e455b1d-d107-449e-bb2e-df1cd97041a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:31.914083 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8e455b1d-d107-449e-bb2e-df1cd97041a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:31.914940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8e455b1d-d107-449e-bb2e-df1cd97041a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:31.915591 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8e455b1d-d107-449e-bb2e-df1cd97041a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:31.917892 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8e455b1d-d107-449e-bb2e-df1cd97041a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:31.918492 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8e455b1d-d107-449e-bb2e-df1cd97041a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:31.919135 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8e455b1d-d107-449e-bb2e-df1cd97041a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:32.121752 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-8e455b1d-d107-449e-bb2e-df1cd97041a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:32.132568 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-8e455b1d-d107-449e-bb2e-df1cd97041a5 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1688 microversion: 2.1 time: 0.235925 Aug 30 01:06:32.133160 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 302/613] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:31 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1688 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:32.138310 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-363aaf3f-95dd-4a5b-9481-a06c32075d49 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:32.138910 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-363aaf3f-95dd-4a5b-9481-a06c32075d49 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:32.154882 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-363aaf3f-95dd-4a5b-9481-a06c32075d49 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:32.157437 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-363aaf3f-95dd-4a5b-9481-a06c32075d49 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:32.158755 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-363aaf3f-95dd-4a5b-9481-a06c32075d49 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:32.160783 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-363aaf3f-95dd-4a5b-9481-a06c32075d49 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:32.161383 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-363aaf3f-95dd-4a5b-9481-a06c32075d49 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:32.161891 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-363aaf3f-95dd-4a5b-9481-a06c32075d49 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:32.166800 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:32.429556 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-363aaf3f-95dd-4a5b-9481-a06c32075d49 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:32.438631 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-363aaf3f-95dd-4a5b-9481-a06c32075d49 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7" status: 200 len: 1364 microversion: 2.1 time: 0.303714 Aug 30 01:06:32.451924 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 303/614] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:32 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 => generated 1364 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:32.508938 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-7084f9c1-a22b-4188-97e5-95d5874e443d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Flavor limits 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:06:32.509391 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-7084f9c1-a22b-4188-97e5-95d5874e443d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Image limits 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:06:32.509867 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-7084f9c1-a22b-4188-97e5-95d5874e443d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Flavor pref 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:06:32.510279 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-7084f9c1-a22b-4188-97e5-95d5874e443d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Image pref 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:06:32.510699 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-7084f9c1-a22b-4188-97e5-95d5874e443d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:06:32.522586 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7084f9c1-a22b-4188-97e5-95d5874e443d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:32.523081 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7084f9c1-a22b-4188-97e5-95d5874e443d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:32.523708 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7084f9c1-a22b-4188-97e5-95d5874e443d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:32.524426 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7084f9c1-a22b-4188-97e5-95d5874e443d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:32.525115 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7084f9c1-a22b-4188-97e5-95d5874e443d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:32.525535 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7084f9c1-a22b-4188-97e5-95d5874e443d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:32.544280 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-7084f9c1-a22b-4188-97e5-95d5874e443d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Getting quotas for project 0596692dbfb149139a1e72159c6f93db. Resources: {'ram', 'instances', 'cores'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:06:32.550420 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-7084f9c1-a22b-4188-97e5-95d5874e443d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Getting quotas for user cc7cf306aadb45d1b65252b53c86b612 and project 0596692dbfb149139a1e72159c6f93db. Resources: {'ram', 'instances', 'cores'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:06:32.563590 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-7084f9c1-a22b-4188-97e5-95d5874e443d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Going to run 1 instances... {{(pid=120630) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:06:32.565877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-7084f9c1-a22b-4188-97e5-95d5874e443d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6c817b5-c41c-4210-a963-172386e2e582',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:06:32.600349 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:32.627241 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-7084f9c1-a22b-4188-97e5-95d5874e443d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.879354 Aug 30 01:06:32.628253 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 312/615] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 30 01:06:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 01:06:32.638852 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-462628fd-249c-40eb-8df7-d65e41038b84 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:32.641062 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-462628fd-249c-40eb-8df7-d65e41038b84 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:32.714632 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-462628fd-249c-40eb-8df7-d65e41038b84 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:32.723130 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-462628fd-249c-40eb-8df7-d65e41038b84 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2" status: 200 len: 1241 microversion: 2.1 time: 0.088097 Aug 30 01:06:32.724348 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 304/616] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:32 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:33.153278 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8eaa9360-b7a6-4839-a620-dbe2e418186d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:33.154365 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8eaa9360-b7a6-4839-a620-dbe2e418186d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:33.164338 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8eaa9360-b7a6-4839-a620-dbe2e418186d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:33.164931 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8eaa9360-b7a6-4839-a620-dbe2e418186d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:33.165693 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8eaa9360-b7a6-4839-a620-dbe2e418186d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:33.166460 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8eaa9360-b7a6-4839-a620-dbe2e418186d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:33.166980 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8eaa9360-b7a6-4839-a620-dbe2e418186d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:33.167471 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8eaa9360-b7a6-4839-a620-dbe2e418186d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:33.382388 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8eaa9360-b7a6-4839-a620-dbe2e418186d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:33.391044 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8eaa9360-b7a6-4839-a620-dbe2e418186d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1688 microversion: 2.1 time: 0.241636 Aug 30 01:06:33.400044 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 313/617] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:33 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1688 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:33.459642 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e07cdfcc-e8fa-4e69-8eea-21a69da95b01 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:33.460441 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e07cdfcc-e8fa-4e69-8eea-21a69da95b01 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:33.467430 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e07cdfcc-e8fa-4e69-8eea-21a69da95b01 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:33.468132 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e07cdfcc-e8fa-4e69-8eea-21a69da95b01 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:33.468629 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e07cdfcc-e8fa-4e69-8eea-21a69da95b01 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:33.469419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e07cdfcc-e8fa-4e69-8eea-21a69da95b01 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:33.469950 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e07cdfcc-e8fa-4e69-8eea-21a69da95b01 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:33.470609 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e07cdfcc-e8fa-4e69-8eea-21a69da95b01 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:33.677543 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e07cdfcc-e8fa-4e69-8eea-21a69da95b01 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:33.686930 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e07cdfcc-e8fa-4e69-8eea-21a69da95b01 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7" status: 200 len: 1364 microversion: 2.1 time: 0.230696 Aug 30 01:06:33.687528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 305/618] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:33 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:33.744439 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8c0dbbf2-c492-428c-8ce0-3ad79fe0f8e4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:33.745102 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8c0dbbf2-c492-428c-8ce0-3ad79fe0f8e4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:33.751592 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8c0dbbf2-c492-428c-8ce0-3ad79fe0f8e4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:33.752073 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8c0dbbf2-c492-428c-8ce0-3ad79fe0f8e4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:33.752498 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8c0dbbf2-c492-428c-8ce0-3ad79fe0f8e4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:33.753213 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8c0dbbf2-c492-428c-8ce0-3ad79fe0f8e4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:33.753658 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8c0dbbf2-c492-428c-8ce0-3ad79fe0f8e4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:33.754076 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8c0dbbf2-c492-428c-8ce0-3ad79fe0f8e4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:33.901498 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8c0dbbf2-c492-428c-8ce0-3ad79fe0f8e4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:33.910528 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8c0dbbf2-c492-428c-8ce0-3ad79fe0f8e4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2" status: 200 len: 1245 microversion: 2.1 time: 0.169994 Aug 30 01:06:33.911102 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 314/619] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:33 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 => generated 1245 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:34.412983 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-6855dce1-769d-4270-9339-23aebfb0ca03 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:34.414479 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-6855dce1-769d-4270-9339-23aebfb0ca03 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:34.422528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6855dce1-769d-4270-9339-23aebfb0ca03 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:34.423020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6855dce1-769d-4270-9339-23aebfb0ca03 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:34.423451 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6855dce1-769d-4270-9339-23aebfb0ca03 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:34.424420 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6855dce1-769d-4270-9339-23aebfb0ca03 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:34.425264 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6855dce1-769d-4270-9339-23aebfb0ca03 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:34.426448 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6855dce1-769d-4270-9339-23aebfb0ca03 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:34.622882 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6855dce1-769d-4270-9339-23aebfb0ca03 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:34.632445 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-6855dce1-769d-4270-9339-23aebfb0ca03 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1688 microversion: 2.1 time: 0.223470 Aug 30 01:06:34.637132 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 306/620] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:34 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1688 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:34.710139 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4a85e7ef-a1ed-44a4-91fb-bd2990f9f5ec tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:34.710907 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-4a85e7ef-a1ed-44a4-91fb-bd2990f9f5ec tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:34.717337 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4a85e7ef-a1ed-44a4-91fb-bd2990f9f5ec tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:34.718544 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4a85e7ef-a1ed-44a4-91fb-bd2990f9f5ec tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:34.719239 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4a85e7ef-a1ed-44a4-91fb-bd2990f9f5ec tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:34.720259 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4a85e7ef-a1ed-44a4-91fb-bd2990f9f5ec tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:34.721118 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4a85e7ef-a1ed-44a4-91fb-bd2990f9f5ec tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:34.721638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4a85e7ef-a1ed-44a4-91fb-bd2990f9f5ec tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:34.868131 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-4a85e7ef-a1ed-44a4-91fb-bd2990f9f5ec tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:34.876874 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-4a85e7ef-a1ed-44a4-91fb-bd2990f9f5ec tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7" status: 200 len: 1364 microversion: 2.1 time: 0.171959 Aug 30 01:06:34.877805 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 315/621] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:34 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:34.931811 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-87e0facd-cbc1-4c41-ba20-28e66640f48b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:34.932458 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-87e0facd-cbc1-4c41-ba20-28e66640f48b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:34.941049 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-87e0facd-cbc1-4c41-ba20-28e66640f48b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:34.941583 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-87e0facd-cbc1-4c41-ba20-28e66640f48b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:34.942019 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-87e0facd-cbc1-4c41-ba20-28e66640f48b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:34.942731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-87e0facd-cbc1-4c41-ba20-28e66640f48b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:34.943328 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-87e0facd-cbc1-4c41-ba20-28e66640f48b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:34.943759 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-87e0facd-cbc1-4c41-ba20-28e66640f48b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:35.005580 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-87e0facd-cbc1-4c41-ba20-28e66640f48b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:35.013789 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-87e0facd-cbc1-4c41-ba20-28e66640f48b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2" status: 200 len: 1245 microversion: 2.1 time: 0.085719 Aug 30 01:06:35.014514 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 307/622] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:34 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:35.658448 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8ad0d330-9344-4990-a159-c71013b12cb2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:35.659864 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8ad0d330-9344-4990-a159-c71013b12cb2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:35.668298 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ad0d330-9344-4990-a159-c71013b12cb2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:35.668995 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ad0d330-9344-4990-a159-c71013b12cb2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:35.670385 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ad0d330-9344-4990-a159-c71013b12cb2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:35.673787 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ad0d330-9344-4990-a159-c71013b12cb2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:35.674480 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ad0d330-9344-4990-a159-c71013b12cb2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:35.675082 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ad0d330-9344-4990-a159-c71013b12cb2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:35.897555 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-ad65f0d9-8938-4b0e-a1a4-a010cf04b9ae tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:35.898888 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-ad65f0d9-8938-4b0e-a1a4-a010cf04b9ae tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:35.906776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ad65f0d9-8938-4b0e-a1a4-a010cf04b9ae tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:35.907312 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ad65f0d9-8938-4b0e-a1a4-a010cf04b9ae tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:35.907687 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ad65f0d9-8938-4b0e-a1a4-a010cf04b9ae tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:35.908398 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ad65f0d9-8938-4b0e-a1a4-a010cf04b9ae tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:35.908851 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ad65f0d9-8938-4b0e-a1a4-a010cf04b9ae tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:35.909298 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ad65f0d9-8938-4b0e-a1a4-a010cf04b9ae tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:36.082931 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8ad0d330-9344-4990-a159-c71013b12cb2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:36.095205 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8ad0d330-9344-4990-a159-c71013b12cb2 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1688 microversion: 2.1 time: 0.445122 Aug 30 01:06:36.096486 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 316/623] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:35 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1688 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:36.103945 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-57ed897f-ca55-45e5-95f3-6c34bed24a9e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:36.105179 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-57ed897f-ca55-45e5-95f3-6c34bed24a9e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:36.117022 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-57ed897f-ca55-45e5-95f3-6c34bed24a9e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:36.118784 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-57ed897f-ca55-45e5-95f3-6c34bed24a9e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:36.119327 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-57ed897f-ca55-45e5-95f3-6c34bed24a9e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:36.120314 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-57ed897f-ca55-45e5-95f3-6c34bed24a9e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:36.120700 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-57ed897f-ca55-45e5-95f3-6c34bed24a9e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:36.121231 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-57ed897f-ca55-45e5-95f3-6c34bed24a9e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:36.290607 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-ad65f0d9-8938-4b0e-a1a4-a010cf04b9ae tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:36.299206 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-ad65f0d9-8938-4b0e-a1a4-a010cf04b9ae tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7" status: 200 len: 1364 microversion: 2.1 time: 0.405444 Aug 30 01:06:36.312988 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 308/624] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:35 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 => generated 1364 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:06:36.313418 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-57ed897f-ca55-45e5-95f3-6c34bed24a9e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:36.327759 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-57ed897f-ca55-45e5-95f3-6c34bed24a9e tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2" status: 200 len: 1301 microversion: 2.1 time: 0.229688 Aug 30 01:06:36.346502 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 317/625] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:36 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 => generated 1301 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:36.552504 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-292ff280-828e-491e-a6ed-267adb337430 req-276b0d7e-6f4a-4b71-9579-b556382bec7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4992ee7f-4690-467a-ab17-9cd2161482b7", "tag": "b6a65e7b-a007-4ec5-97e9-6d73e85712b7"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:36.564600 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-292ff280-828e-491e-a6ed-267adb337430 req-276b0d7e-6f4a-4b71-9579-b556382bec7b service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:36.565369 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-292ff280-828e-491e-a6ed-267adb337430 req-276b0d7e-6f4a-4b71-9579-b556382bec7b service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:36.566032 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-292ff280-828e-491e-a6ed-267adb337430 req-276b0d7e-6f4a-4b71-9579-b556382bec7b service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:36.579502 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-292ff280-828e-491e-a6ed-267adb337430 req-276b0d7e-6f4a-4b71-9579-b556382bec7b service nova] Creating event network-changed:b6a65e7b-a007-4ec5-97e9-6d73e85712b7 for instance 4992ee7f-4690-467a-ab17-9cd2161482b7 on hv-cinder-81514 Aug 30 01:06:36.585994 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-292ff280-828e-491e-a6ed-267adb337430 req-276b0d7e-6f4a-4b71-9579-b556382bec7b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.221311 Aug 30 01:06:36.586924 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 309/626] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:37.119979 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-2220c7c3-d18d-4ced-8474-6d39b46a1f78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:37.120582 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-2220c7c3-d18d-4ced-8474-6d39b46a1f78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:37.127424 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2220c7c3-d18d-4ced-8474-6d39b46a1f78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:37.127908 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2220c7c3-d18d-4ced-8474-6d39b46a1f78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:37.128341 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2220c7c3-d18d-4ced-8474-6d39b46a1f78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:37.129031 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2220c7c3-d18d-4ced-8474-6d39b46a1f78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:37.129511 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2220c7c3-d18d-4ced-8474-6d39b46a1f78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:37.129930 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2220c7c3-d18d-4ced-8474-6d39b46a1f78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:37.255007 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-2220c7c3-d18d-4ced-8474-6d39b46a1f78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:37.267676 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-2220c7c3-d18d-4ced-8474-6d39b46a1f78 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1620 microversion: 2.1 time: 0.151806 Aug 30 01:06:37.268808 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 318/627] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:37 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1620 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:06:37.321589 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3123aa1b-9af1-4915-9f1f-8de47aab5fd1 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:37.322210 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-3123aa1b-9af1-4915-9f1f-8de47aab5fd1 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:37.329414 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3123aa1b-9af1-4915-9f1f-8de47aab5fd1 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:37.330172 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3123aa1b-9af1-4915-9f1f-8de47aab5fd1 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:37.330888 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3123aa1b-9af1-4915-9f1f-8de47aab5fd1 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:37.331482 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3123aa1b-9af1-4915-9f1f-8de47aab5fd1 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:37.331941 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3123aa1b-9af1-4915-9f1f-8de47aab5fd1 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:37.332367 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3123aa1b-9af1-4915-9f1f-8de47aab5fd1 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:37.361406 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-312d6be3-9b26-4526-8c6e-d709df3ef53f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:37.362031 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-312d6be3-9b26-4526-8c6e-d709df3ef53f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:37.371899 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-312d6be3-9b26-4526-8c6e-d709df3ef53f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:37.372418 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-312d6be3-9b26-4526-8c6e-d709df3ef53f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:37.372864 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-312d6be3-9b26-4526-8c6e-d709df3ef53f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:37.373611 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-312d6be3-9b26-4526-8c6e-d709df3ef53f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:37.383316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-312d6be3-9b26-4526-8c6e-d709df3ef53f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:37.383631 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-312d6be3-9b26-4526-8c6e-d709df3ef53f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:37.506550 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-312d6be3-9b26-4526-8c6e-d709df3ef53f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:37.515189 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-312d6be3-9b26-4526-8c6e-d709df3ef53f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2" status: 200 len: 1299 microversion: 2.1 time: 0.157935 Aug 30 01:06:37.516092 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 319/628] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:37 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 => generated 1299 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:37.522245 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-65b77c4d-8d01-43a0-899f-b2926b4e6597 req-5c50928a-6c75-4753-811f-8542fd52074b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cff4036-ef80-4791-92b5-0c71c8e93582", "name": "network-vif-deleted", "tag": "737df1fc-0996-483b-b4f3-e6055a0f4df0"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:37.532729 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-65b77c4d-8d01-43a0-899f-b2926b4e6597 req-5c50928a-6c75-4753-811f-8542fd52074b service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:37.533328 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-65b77c4d-8d01-43a0-899f-b2926b4e6597 req-5c50928a-6c75-4753-811f-8542fd52074b service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:37.534216 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-65b77c4d-8d01-43a0-899f-b2926b4e6597 req-5c50928a-6c75-4753-811f-8542fd52074b service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:37.546072 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-65b77c4d-8d01-43a0-899f-b2926b4e6597 req-5c50928a-6c75-4753-811f-8542fd52074b service nova] Creating event network-vif-deleted:737df1fc-0996-483b-b4f3-e6055a0f4df0 for instance 2cff4036-ef80-4791-92b5-0c71c8e93582 on hv-cinder-81514 Aug 30 01:06:37.551493 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-65b77c4d-8d01-43a0-899f-b2926b4e6597 req-5c50928a-6c75-4753-811f-8542fd52074b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033840 Aug 30 01:06:37.552085 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 320/629] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:37.638041 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3123aa1b-9af1-4915-9f1f-8de47aab5fd1 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:37.647352 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3123aa1b-9af1-4915-9f1f-8de47aab5fd1 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7" status: 200 len: 1364 microversion: 2.1 time: 0.331005 Aug 30 01:06:37.648134 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 310/630] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:37 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 => generated 1364 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:38.292865 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-477f2575-faef-44c1-ae62-2316a7246c5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:38.294970 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-477f2575-faef-44c1-ae62-2316a7246c5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:38.304524 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-477f2575-faef-44c1-ae62-2316a7246c5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:38.305266 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-477f2575-faef-44c1-ae62-2316a7246c5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:38.305703 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-477f2575-faef-44c1-ae62-2316a7246c5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:38.306484 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-477f2575-faef-44c1-ae62-2316a7246c5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:38.307026 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-477f2575-faef-44c1-ae62-2316a7246c5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:38.307454 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-477f2575-faef-44c1-ae62-2316a7246c5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:38.326447 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=100 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:38.344278 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-477f2575-faef-44c1-ae62-2316a7246c5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:38.344758 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-477f2575-faef-44c1-ae62-2316a7246c5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:38.345222 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-477f2575-faef-44c1-ae62-2316a7246c5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:38.345769 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.objects.instance [None req-477f2575-faef-44c1-ae62-2316a7246c5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lazy-loading 'fault' on Instance uuid 2cff4036-ef80-4791-92b5-0c71c8e93582 {{(pid=120630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:06:38.404855 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-477f2575-faef-44c1-ae62-2316a7246c5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:38.417908 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-477f2575-faef-44c1-ae62-2316a7246c5a tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 200 len: 1334 microversion: 2.1 time: 0.129925 Aug 30 01:06:38.423991 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 321/631] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:38 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 1334 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:38.541387 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-6f498222-e67d-486d-b082-f9966ffffcd4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:38.543703 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-6f498222-e67d-486d-b082-f9966ffffcd4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:38.552209 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=2 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:38.564395 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6f498222-e67d-486d-b082-f9966ffffcd4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:38.565137 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6f498222-e67d-486d-b082-f9966ffffcd4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:38.565593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6f498222-e67d-486d-b082-f9966ffffcd4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:38.566946 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6f498222-e67d-486d-b082-f9966ffffcd4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:38.568212 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6f498222-e67d-486d-b082-f9966ffffcd4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:38.568866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6f498222-e67d-486d-b082-f9966ffffcd4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:38.670377 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-6bd5a883-8823-46ae-8c31-384026df0100 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:38.671785 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-6bd5a883-8823-46ae-8c31-384026df0100 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:38.678436 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6bd5a883-8823-46ae-8c31-384026df0100 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:38.678925 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6bd5a883-8823-46ae-8c31-384026df0100 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:38.679361 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6bd5a883-8823-46ae-8c31-384026df0100 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:38.680074 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6bd5a883-8823-46ae-8c31-384026df0100 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:38.680527 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6bd5a883-8823-46ae-8c31-384026df0100 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:38.681166 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6bd5a883-8823-46ae-8c31-384026df0100 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:38.987738 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6f498222-e67d-486d-b082-f9966ffffcd4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:38.995250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-6f498222-e67d-486d-b082-f9966ffffcd4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2" status: 200 len: 1367 microversion: 2.1 time: 0.462959 Aug 30 01:06:38.995814 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 311/632] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:38 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 => generated 1367 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:39.054949 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-6bd5a883-8823-46ae-8c31-384026df0100 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:39.062822 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-6bd5a883-8823-46ae-8c31-384026df0100 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7" status: 200 len: 1364 microversion: 2.1 time: 0.396432 Aug 30 01:06:39.063408 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 322/633] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:38 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 => generated 1364 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:39.443494 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-2b1bc224-5534-4893-af11-6e11423fe29f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:39.444882 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-2b1bc224-5534-4893-af11-6e11423fe29f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 2cff4036-ef80-4791-92b5-0c71c8e93582] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:39.450843 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2b1bc224-5534-4893-af11-6e11423fe29f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:39.451415 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2b1bc224-5534-4893-af11-6e11423fe29f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:39.452568 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2b1bc224-5534-4893-af11-6e11423fe29f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:39.453592 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2b1bc224-5534-4893-af11-6e11423fe29f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:39.454129 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2b1bc224-5534-4893-af11-6e11423fe29f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:39.454660 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2b1bc224-5534-4893-af11-6e11423fe29f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:39.468053 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-2b1bc224-5534-4893-af11-6e11423fe29f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] HTTP exception thrown: Instance 2cff4036-ef80-4791-92b5-0c71c8e93582 could not be found. Aug 30 01:06:39.469697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-2b1bc224-5534-4893-af11-6e11423fe29f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Request method failure captured: Aug 30 01:06:39.469697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 HTTP/1.1 Aug 30 01:06:39.469697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:06:39.469697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:06:39.469697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:06:39.469697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:06:39.469697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:06:39.469697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:06:39.469697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:06:39.469697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:06:39.469697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWFZl1eXeWdEDlle0hI0paFtZlD2PL7IqHhMTCZh9t4-qj1yZKZ-oMZd8isPpWOq6EPoKdYey1DgasN-d057FigVzeaBK7xvIgMM59Rae3evOwrcybdKfuqMiKZ3wBQJQbTCDy7Hwhm_wrs2y5ZbRIUIowk7aEYT1BJ8gns6uC2nhJw Aug 30 01:06:39.469697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:06:39.469697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:06:39.469697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:06:39.469697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:06:39.469697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:06:39.469697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:06:39.469697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: ceebbaa5dd9d4110a6393190c5b466f0 Aug 30 01:06:39.469697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-436411527 Aug 30 01:06:39.469697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:06:39.469697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:06:39.471161 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ceebbaa5dd9d4110a6393190c5b466f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ceebbaa5dd9d4110a6393190c5b466f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ceebbaa5dd9d4110a6393190c5b466f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ceebbaa5dd9d4110a6393190c5b466f0"}]}] Aug 30 01:06:39.471161 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-ServerRescueNegativeTestJSON-436411527 Aug 30 01:06:39.471161 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: ceebbaa5dd9d4110a6393190c5b466f0 Aug 30 01:06:39.471161 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-436411527 Aug 30 01:06:39.471161 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-ServerRescueNegativeTestJSON-436411527-project Aug 30 01:06:39.471161 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:06:39.471161 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:06:39.471161 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: 5c95c8ce27fd43c6a6fe10443b6bde13 Aug 30 01:06:39.471161 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-ServerRescueNegativeTestJSON-436411527-project Aug 30 01:06:39.471161 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:06:39.471161 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Instance 2cff4036-ef80-4791-92b5-0c71c8e93582 could not be found. Aug 30 01:06:39.471161 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': '2cff4036-ef80-4791-92b5-0c71c8e93582'} Aug 30 01:06:39.471899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:06:39.471899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:39.471899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:06:39.471899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:06:39.471899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:06:39.471899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:06:39.471899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:06:39.471899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:06:39.471899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:06:39.471899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:06:39.471899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cff4036-ef80-4791-92b5-0c71c8e93582 could not be found. Aug 30 01:06:39.471899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:39.471899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:39.471899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:39.471899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:39.471899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:39.471899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:39.471899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:06:39.471899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:06:39.471899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:06:39.474082 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:06:39.474082 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:06:39.474082 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:06:39.474082 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:06:39.474082 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:06:39.474082 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:06:39.474082 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:06:39.474082 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cff4036-ef80-4791-92b5-0c71c8e93582 could not be found. Aug 30 01:06:39.474082 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:39.474082 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:39.474082 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:39.474082 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:39.474082 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:39.474082 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:39.474082 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:06:39.474082 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:06:39.474082 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cff4036-ef80-4791-92b5-0c71c8e93582 could not be found. Aug 30 01:06:39.474082 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:39.475721 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-2b1bc224-5534-4893-af11-6e11423fe29f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Returning 404 to user: Instance 2cff4036-ef80-4791-92b5-0c71c8e93582 could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:06:39.475721 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-2b1bc224-5534-4893-af11-6e11423fe29f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582" status: 404 len: 111 microversion: 2.1 time: 0.031591 Aug 30 01:06:39.475721 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 312/634] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:39 2022] GET /compute/v2.1/servers/2cff4036-ef80-4791-92b5-0c71c8e93582 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:06:39.479653 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-76f24312-ee7b-4f7f-9cb5-404a6f8a8c73 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '.version_select at 0x7f0f525cd700>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:39.499508 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-76f24312-ee7b-4f7f-9cb5-404a6f8a8c73 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-366021714" status: 202 len: 0 microversion: 2.1 time: 0.022661 Aug 30 01:06:39.500430 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 323/635] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Aug 30 01:06:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-366021714 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:06:39.581381 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-78af8d6c-7c54-4d3d-ac4b-c04b0551536c req-8997b3f8-b26b-4ff7-9ea9-61bdec0344d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d738b454-d1e4-4298-93f4-d0db045454f2", "tag": "13333188-9b10-4db5-9b32-d0a0505dcd3b"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:39.591574 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-78af8d6c-7c54-4d3d-ac4b-c04b0551536c req-8997b3f8-b26b-4ff7-9ea9-61bdec0344d5 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:39.592046 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-78af8d6c-7c54-4d3d-ac4b-c04b0551536c req-8997b3f8-b26b-4ff7-9ea9-61bdec0344d5 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:39.592619 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-78af8d6c-7c54-4d3d-ac4b-c04b0551536c req-8997b3f8-b26b-4ff7-9ea9-61bdec0344d5 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:39.604154 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-78af8d6c-7c54-4d3d-ac4b-c04b0551536c req-8997b3f8-b26b-4ff7-9ea9-61bdec0344d5 service nova] Creating event network-changed:13333188-9b10-4db5-9b32-d0a0505dcd3b for instance d738b454-d1e4-4298-93f4-d0db045454f2 on hv-cinder-81514 Aug 30 01:06:39.610206 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-78af8d6c-7c54-4d3d-ac4b-c04b0551536c req-8997b3f8-b26b-4ff7-9ea9-61bdec0344d5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033215 Aug 30 01:06:39.610811 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 313/636] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:39.906643 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-7c3e41f8-ebfc-44ee-9986-1da2f329f2ac req-459ebb26-edbf-496c-8075-a7211e047a6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4992ee7f-4690-467a-ab17-9cd2161482b7", "name": "network-vif-plugged", "status": "completed", "tag": "b6a65e7b-a007-4ec5-97e9-6d73e85712b7"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:39.919259 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-7c3e41f8-ebfc-44ee-9986-1da2f329f2ac req-459ebb26-edbf-496c-8075-a7211e047a6a service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:39.920093 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-7c3e41f8-ebfc-44ee-9986-1da2f329f2ac req-459ebb26-edbf-496c-8075-a7211e047a6a service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:39.920526 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-7c3e41f8-ebfc-44ee-9986-1da2f329f2ac req-459ebb26-edbf-496c-8075-a7211e047a6a service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:39.931947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-7c3e41f8-ebfc-44ee-9986-1da2f329f2ac req-459ebb26-edbf-496c-8075-a7211e047a6a service nova] Creating event network-vif-plugged:b6a65e7b-a007-4ec5-97e9-6d73e85712b7 for instance 4992ee7f-4690-467a-ab17-9cd2161482b7 on hv-cinder-81514 Aug 30 01:06:39.938434 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-7c3e41f8-ebfc-44ee-9986-1da2f329f2ac req-459ebb26-edbf-496c-8075-a7211e047a6a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037087 Aug 30 01:06:39.939126 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 324/637] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:40.016554 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0312a8b9-4982-4d4b-80ec-ca1d71fefe3f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:40.017406 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-0312a8b9-4982-4d4b-80ec-ca1d71fefe3f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:40.023596 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0312a8b9-4982-4d4b-80ec-ca1d71fefe3f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:40.024258 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0312a8b9-4982-4d4b-80ec-ca1d71fefe3f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:40.024712 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0312a8b9-4982-4d4b-80ec-ca1d71fefe3f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:40.025536 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0312a8b9-4982-4d4b-80ec-ca1d71fefe3f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:40.025994 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0312a8b9-4982-4d4b-80ec-ca1d71fefe3f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:40.026486 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0312a8b9-4982-4d4b-80ec-ca1d71fefe3f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:40.084012 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-d17f0ed0-4f8d-4a64-b028-0bdeab44e840 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:40.084858 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-d17f0ed0-4f8d-4a64-b028-0bdeab44e840 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:40.092207 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d17f0ed0-4f8d-4a64-b028-0bdeab44e840 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:40.093412 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d17f0ed0-4f8d-4a64-b028-0bdeab44e840 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:40.094013 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d17f0ed0-4f8d-4a64-b028-0bdeab44e840 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:40.094780 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d17f0ed0-4f8d-4a64-b028-0bdeab44e840 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:40.095306 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d17f0ed0-4f8d-4a64-b028-0bdeab44e840 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:40.095800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d17f0ed0-4f8d-4a64-b028-0bdeab44e840 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:40.292421 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-0312a8b9-4982-4d4b-80ec-ca1d71fefe3f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:40.301881 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0312a8b9-4982-4d4b-80ec-ca1d71fefe3f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2" status: 200 len: 1367 microversion: 2.1 time: 0.289522 Aug 30 01:06:40.302807 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 314/638] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:40 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:40.309141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-d17f0ed0-4f8d-4a64-b028-0bdeab44e840 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:40.317534 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-d17f0ed0-4f8d-4a64-b028-0bdeab44e840 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7" status: 200 len: 1364 microversion: 2.1 time: 0.237699 Aug 30 01:06:40.318171 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 325/639] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:40 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:06:41.323215 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-01dce0c9-2d25-4166-b3cf-9391d2ab6f73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:41.323891 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-01dce0c9-2d25-4166-b3cf-9391d2ab6f73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:41.332085 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-01dce0c9-2d25-4166-b3cf-9391d2ab6f73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:41.332085 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-01dce0c9-2d25-4166-b3cf-9391d2ab6f73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:41.332527 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-01dce0c9-2d25-4166-b3cf-9391d2ab6f73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:41.333262 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-01dce0c9-2d25-4166-b3cf-9391d2ab6f73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:41.333746 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-01dce0c9-2d25-4166-b3cf-9391d2ab6f73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:41.337039 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-01dce0c9-2d25-4166-b3cf-9391d2ab6f73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:41.341671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-ba5525bd-fa99-42af-bfbd-4512b98f2016 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:41.343158 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-ba5525bd-fa99-42af-bfbd-4512b98f2016 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:41.350096 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ba5525bd-fa99-42af-bfbd-4512b98f2016 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:41.350823 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ba5525bd-fa99-42af-bfbd-4512b98f2016 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:41.351613 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ba5525bd-fa99-42af-bfbd-4512b98f2016 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:41.352496 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ba5525bd-fa99-42af-bfbd-4512b98f2016 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:41.356619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ba5525bd-fa99-42af-bfbd-4512b98f2016 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:41.359489 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ba5525bd-fa99-42af-bfbd-4512b98f2016 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:41.639998 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-ba5525bd-fa99-42af-bfbd-4512b98f2016 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:41.647944 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-ba5525bd-fa99-42af-bfbd-4512b98f2016 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7" status: 200 len: 1364 microversion: 2.1 time: 0.312634 Aug 30 01:06:41.648516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 326/640] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:41 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 => generated 1364 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:41.651857 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-01dce0c9-2d25-4166-b3cf-9391d2ab6f73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:41.660724 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-01dce0c9-2d25-4166-b3cf-9391d2ab6f73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2" status: 200 len: 1367 microversion: 2.1 time: 0.341437 Aug 30 01:06:41.661424 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 315/641] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:41 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 => generated 1367 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:42.507947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-27f20267-008e-48a2-96c0-0a332b57461d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:42.508503 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-27f20267-008e-48a2-96c0-0a332b57461d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:42.515455 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-27f20267-008e-48a2-96c0-0a332b57461d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:42.515998 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-27f20267-008e-48a2-96c0-0a332b57461d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:42.516439 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-27f20267-008e-48a2-96c0-0a332b57461d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:42.517350 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-27f20267-008e-48a2-96c0-0a332b57461d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:42.517803 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-27f20267-008e-48a2-96c0-0a332b57461d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:42.518248 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-27f20267-008e-48a2-96c0-0a332b57461d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:42.536830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=2 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:42.544925 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-27f20267-008e-48a2-96c0-0a332b57461d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Going to try to terminate instance {{(pid=120630) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:06:42.558774 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=12 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:42.618662 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-27f20267-008e-48a2-96c0-0a332b57461d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "DELETE /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 204 len: 0 microversion: 2.1 time: 0.114196 Aug 30 01:06:42.619329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 327/642] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:06:42 2022] DELETE /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:06:42.629998 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-4a5851d5-fe0c-4f42-bf4b-1a7154b2a29d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:42.630602 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-4a5851d5-fe0c-4f42-bf4b-1a7154b2a29d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:42.637426 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4a5851d5-fe0c-4f42-bf4b-1a7154b2a29d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:42.637897 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4a5851d5-fe0c-4f42-bf4b-1a7154b2a29d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:42.638326 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4a5851d5-fe0c-4f42-bf4b-1a7154b2a29d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:42.639554 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4a5851d5-fe0c-4f42-bf4b-1a7154b2a29d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:42.640014 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4a5851d5-fe0c-4f42-bf4b-1a7154b2a29d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:42.640463 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4a5851d5-fe0c-4f42-bf4b-1a7154b2a29d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:42.672008 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-72de6225-5d85-468d-8f9d-3e8459fe2e85 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:42.672747 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-72de6225-5d85-468d-8f9d-3e8459fe2e85 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:42.680282 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-72de6225-5d85-468d-8f9d-3e8459fe2e85 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:42.680776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-72de6225-5d85-468d-8f9d-3e8459fe2e85 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:42.681321 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-72de6225-5d85-468d-8f9d-3e8459fe2e85 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:42.682135 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-72de6225-5d85-468d-8f9d-3e8459fe2e85 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:42.682614 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-72de6225-5d85-468d-8f9d-3e8459fe2e85 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:42.683041 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-72de6225-5d85-468d-8f9d-3e8459fe2e85 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:42.719911 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=12 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:42.832963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-4a5851d5-fe0c-4f42-bf4b-1a7154b2a29d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:42.840551 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-4a5851d5-fe0c-4f42-bf4b-1a7154b2a29d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1507 microversion: 2.1 time: 0.215974 Aug 30 01:06:42.841202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 316/643] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:42 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1507 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:42.846065 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-ee1d0be6-9d78-4af6-a407-64cd536a918d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:42.846671 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-ee1d0be6-9d78-4af6-a407-64cd536a918d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:42.852107 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ee1d0be6-9d78-4af6-a407-64cd536a918d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:42.852579 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ee1d0be6-9d78-4af6-a407-64cd536a918d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:42.853006 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ee1d0be6-9d78-4af6-a407-64cd536a918d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:42.853710 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ee1d0be6-9d78-4af6-a407-64cd536a918d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:42.854162 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ee1d0be6-9d78-4af6-a407-64cd536a918d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:42.854576 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ee1d0be6-9d78-4af6-a407-64cd536a918d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:42.865885 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-72de6225-5d85-468d-8f9d-3e8459fe2e85 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:42.873657 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-72de6225-5d85-468d-8f9d-3e8459fe2e85 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7" status: 200 len: 1550 microversion: 2.1 time: 0.206135 Aug 30 01:06:42.874579 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 328/644] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:42 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 => generated 1550 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:06:42.895129 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-76ce28fc-071d-4e92-a82f-b982c4c84fd3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:42.895626 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-76ce28fc-071d-4e92-a82f-b982c4c84fd3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:42.901457 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-76ce28fc-071d-4e92-a82f-b982c4c84fd3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:42.901943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-76ce28fc-071d-4e92-a82f-b982c4c84fd3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:42.902380 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-76ce28fc-071d-4e92-a82f-b982c4c84fd3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:42.903075 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-76ce28fc-071d-4e92-a82f-b982c4c84fd3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:42.903530 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-76ce28fc-071d-4e92-a82f-b982c4c84fd3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:42.903955 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-76ce28fc-071d-4e92-a82f-b982c4c84fd3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:43.000473 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-76ce28fc-071d-4e92-a82f-b982c4c84fd3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109102 Aug 30 01:06:43.001094 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 329/645] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 30 01:06:42 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:06:43.024712 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-ee1d0be6-9d78-4af6-a407-64cd536a918d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:43.032470 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-ee1d0be6-9d78-4af6-a407-64cd536a918d tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2" status: 200 len: 1367 microversion: 2.1 time: 0.190264 Aug 30 01:06:43.033267 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 317/646] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:42 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:43.863379 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-318d65a6-c366-49bb-a498-42cd23bffa0b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:43.863908 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-318d65a6-c366-49bb-a498-42cd23bffa0b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:43.871027 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-318d65a6-c366-49bb-a498-42cd23bffa0b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:43.871849 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-318d65a6-c366-49bb-a498-42cd23bffa0b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:43.872288 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-318d65a6-c366-49bb-a498-42cd23bffa0b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:43.872992 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-318d65a6-c366-49bb-a498-42cd23bffa0b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:43.874036 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-318d65a6-c366-49bb-a498-42cd23bffa0b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:43.874783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-318d65a6-c366-49bb-a498-42cd23bffa0b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:43.925839 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-986da5ee-631a-4879-8bf1-1090977af0ab req-c46b49b9-2e0c-4a28-ae8e-f2ab2f1e2ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d738b454-d1e4-4298-93f4-d0db045454f2", "name": "network-vif-plugged", "status": "completed", "tag": "13333188-9b10-4db5-9b32-d0a0505dcd3b"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:43.938461 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-986da5ee-631a-4879-8bf1-1090977af0ab req-c46b49b9-2e0c-4a28-ae8e-f2ab2f1e2ac0 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:43.952574 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-986da5ee-631a-4879-8bf1-1090977af0ab req-c46b49b9-2e0c-4a28-ae8e-f2ab2f1e2ac0 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:43.953532 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-986da5ee-631a-4879-8bf1-1090977af0ab req-c46b49b9-2e0c-4a28-ae8e-f2ab2f1e2ac0 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:43.976550 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-986da5ee-631a-4879-8bf1-1090977af0ab req-c46b49b9-2e0c-4a28-ae8e-f2ab2f1e2ac0 service nova] Creating event network-vif-plugged:13333188-9b10-4db5-9b32-d0a0505dcd3b for instance d738b454-d1e4-4298-93f4-d0db045454f2 on hv-cinder-81514 Aug 30 01:06:43.981557 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-986da5ee-631a-4879-8bf1-1090977af0ab req-c46b49b9-2e0c-4a28-ae8e-f2ab2f1e2ac0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059432 Aug 30 01:06:43.983745 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 318/647] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:06:43.989995 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-68f7cfa6-d9ae-4ad5-9faf-bfcdc4cda8c3 req-e7b49a8c-5294-4358-8371-89d457b1f71d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4992ee7f-4690-467a-ab17-9cd2161482b7", "tag": "b6a65e7b-a007-4ec5-97e9-6d73e85712b7"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:44.003653 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-68f7cfa6-d9ae-4ad5-9faf-bfcdc4cda8c3 req-e7b49a8c-5294-4358-8371-89d457b1f71d service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:44.005183 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-68f7cfa6-d9ae-4ad5-9faf-bfcdc4cda8c3 req-e7b49a8c-5294-4358-8371-89d457b1f71d service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:44.005808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-68f7cfa6-d9ae-4ad5-9faf-bfcdc4cda8c3 req-e7b49a8c-5294-4358-8371-89d457b1f71d service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:44.020500 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-68f7cfa6-d9ae-4ad5-9faf-bfcdc4cda8c3 req-e7b49a8c-5294-4358-8371-89d457b1f71d service nova] Creating event network-changed:b6a65e7b-a007-4ec5-97e9-6d73e85712b7 for instance 4992ee7f-4690-467a-ab17-9cd2161482b7 on hv-cinder-81514 Aug 30 01:06:44.025832 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-68f7cfa6-d9ae-4ad5-9faf-bfcdc4cda8c3 req-e7b49a8c-5294-4358-8371-89d457b1f71d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040556 Aug 30 01:06:44.026563 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 319/648] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:44.054312 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-dbf432ef-19a0-470f-bdf8-ad1a8ec52cab tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:44.055219 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-dbf432ef-19a0-470f-bdf8-ad1a8ec52cab tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:44.064954 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-318d65a6-c366-49bb-a498-42cd23bffa0b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:44.069249 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dbf432ef-19a0-470f-bdf8-ad1a8ec52cab tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:44.069746 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dbf432ef-19a0-470f-bdf8-ad1a8ec52cab tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:44.070180 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dbf432ef-19a0-470f-bdf8-ad1a8ec52cab tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:44.070874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dbf432ef-19a0-470f-bdf8-ad1a8ec52cab tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:44.076081 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dbf432ef-19a0-470f-bdf8-ad1a8ec52cab tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:44.077785 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dbf432ef-19a0-470f-bdf8-ad1a8ec52cab tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:44.081295 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-318d65a6-c366-49bb-a498-42cd23bffa0b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1507 microversion: 2.1 time: 0.222866 Aug 30 01:06:44.081874 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 330/649] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:43 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:44.230353 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-dbf432ef-19a0-470f-bdf8-ad1a8ec52cab tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:44.240359 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-dbf432ef-19a0-470f-bdf8-ad1a8ec52cab tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2" status: 200 len: 1367 microversion: 2.1 time: 0.190393 Aug 30 01:06:44.243334 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 320/650] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:44 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:06:45.102193 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-ef91588b-deb2-40b4-8482-127d4eab4b3b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:45.102990 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-ef91588b-deb2-40b4-8482-127d4eab4b3b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:45.110764 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ef91588b-deb2-40b4-8482-127d4eab4b3b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:45.111252 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ef91588b-deb2-40b4-8482-127d4eab4b3b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:45.111894 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ef91588b-deb2-40b4-8482-127d4eab4b3b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:45.112607 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ef91588b-deb2-40b4-8482-127d4eab4b3b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:45.113103 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ef91588b-deb2-40b4-8482-127d4eab4b3b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:45.113539 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ef91588b-deb2-40b4-8482-127d4eab4b3b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:45.244704 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-ef91588b-deb2-40b4-8482-127d4eab4b3b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:45.259866 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-ef91588b-deb2-40b4-8482-127d4eab4b3b tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1507 microversion: 2.1 time: 0.155129 Aug 30 01:06:45.260494 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 331/651] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:45 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:45.269509 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-870b46dc-3ea5-4a76-9654-454315672760 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:45.271253 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-870b46dc-3ea5-4a76-9654-454315672760 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:45.280160 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-870b46dc-3ea5-4a76-9654-454315672760 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:45.280850 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-870b46dc-3ea5-4a76-9654-454315672760 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:45.281521 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-870b46dc-3ea5-4a76-9654-454315672760 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:45.282223 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-870b46dc-3ea5-4a76-9654-454315672760 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:45.283010 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-870b46dc-3ea5-4a76-9654-454315672760 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:45.283602 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-870b46dc-3ea5-4a76-9654-454315672760 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:45.531486 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-870b46dc-3ea5-4a76-9654-454315672760 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:45.539332 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-870b46dc-3ea5-4a76-9654-454315672760 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2" status: 200 len: 1367 microversion: 2.1 time: 0.275965 Aug 30 01:06:45.539900 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 321/652] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:45 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:46.040907 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-275cba0e-b9da-45fc-a28a-932bcecd9606 req-3e7a3706-fe12-4bfb-8e39-083a5da338b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377d6898-d51c-4029-b9ce-3c96e2840dfd", "name": "network-vif-deleted", "tag": "77835519-6f8f-47e8-9710-2b48c7087257"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:46.051582 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-275cba0e-b9da-45fc-a28a-932bcecd9606 req-3e7a3706-fe12-4bfb-8e39-083a5da338b5 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:46.052162 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-275cba0e-b9da-45fc-a28a-932bcecd9606 req-3e7a3706-fe12-4bfb-8e39-083a5da338b5 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:46.052703 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-275cba0e-b9da-45fc-a28a-932bcecd9606 req-3e7a3706-fe12-4bfb-8e39-083a5da338b5 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:46.064497 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-275cba0e-b9da-45fc-a28a-932bcecd9606 req-3e7a3706-fe12-4bfb-8e39-083a5da338b5 service nova] Creating event network-vif-deleted:77835519-6f8f-47e8-9710-2b48c7087257 for instance 377d6898-d51c-4029-b9ce-3c96e2840dfd on hv-cinder-81514 Aug 30 01:06:46.069336 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-275cba0e-b9da-45fc-a28a-932bcecd9606 req-3e7a3706-fe12-4bfb-8e39-083a5da338b5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032152 Aug 30 01:06:46.069910 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 332/653] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:46.282870 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-81f564e0-8b74-49a7-b81c-8d57dda66e86 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:46.283425 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-81f564e0-8b74-49a7-b81c-8d57dda66e86 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:46.290094 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-81f564e0-8b74-49a7-b81c-8d57dda66e86 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:46.290573 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-81f564e0-8b74-49a7-b81c-8d57dda66e86 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:46.291004 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-81f564e0-8b74-49a7-b81c-8d57dda66e86 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:46.291689 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-81f564e0-8b74-49a7-b81c-8d57dda66e86 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:46.292136 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-81f564e0-8b74-49a7-b81c-8d57dda66e86 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:46.292553 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-81f564e0-8b74-49a7-b81c-8d57dda66e86 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:46.324591 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-81f564e0-8b74-49a7-b81c-8d57dda66e86 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:46.325061 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-81f564e0-8b74-49a7-b81c-8d57dda66e86 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:46.325512 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-81f564e0-8b74-49a7-b81c-8d57dda66e86 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:46.325948 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.objects.instance [None req-81f564e0-8b74-49a7-b81c-8d57dda66e86 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lazy-loading 'fault' on Instance uuid 377d6898-d51c-4029-b9ce-3c96e2840dfd {{(pid=120631) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:06:46.366638 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-81f564e0-8b74-49a7-b81c-8d57dda66e86 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:46.374268 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-81f564e0-8b74-49a7-b81c-8d57dda66e86 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 200 len: 1312 microversion: 2.1 time: 0.095920 Aug 30 01:06:46.374825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 322/654] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:46 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:46.564310 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-cb3f5b27-efb3-407a-8ebc-6eff2a7fd987 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:46.565018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-cb3f5b27-efb3-407a-8ebc-6eff2a7fd987 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:46.571152 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cb3f5b27-efb3-407a-8ebc-6eff2a7fd987 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:46.571633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cb3f5b27-efb3-407a-8ebc-6eff2a7fd987 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:46.572065 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cb3f5b27-efb3-407a-8ebc-6eff2a7fd987 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:46.572749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cb3f5b27-efb3-407a-8ebc-6eff2a7fd987 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:46.573226 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cb3f5b27-efb3-407a-8ebc-6eff2a7fd987 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:46.573950 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cb3f5b27-efb3-407a-8ebc-6eff2a7fd987 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:46.712351 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-cb3f5b27-efb3-407a-8ebc-6eff2a7fd987 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:46.720702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-cb3f5b27-efb3-407a-8ebc-6eff2a7fd987 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2" status: 200 len: 1367 microversion: 2.1 time: 0.163438 Aug 30 01:06:46.721293 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 333/655] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:46 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:47.395890 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3b70dfa0-6452-4cc0-8314-0a8ebf75e6fb tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:47.396500 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-3b70dfa0-6452-4cc0-8314-0a8ebf75e6fb tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 377d6898-d51c-4029-b9ce-3c96e2840dfd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:47.402901 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3b70dfa0-6452-4cc0-8314-0a8ebf75e6fb tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:47.403380 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3b70dfa0-6452-4cc0-8314-0a8ebf75e6fb tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:47.403814 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3b70dfa0-6452-4cc0-8314-0a8ebf75e6fb tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:47.404581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3b70dfa0-6452-4cc0-8314-0a8ebf75e6fb tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:47.405916 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3b70dfa0-6452-4cc0-8314-0a8ebf75e6fb tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:47.406348 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3b70dfa0-6452-4cc0-8314-0a8ebf75e6fb tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:47.419550 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-3b70dfa0-6452-4cc0-8314-0a8ebf75e6fb tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] HTTP exception thrown: Instance 377d6898-d51c-4029-b9ce-3c96e2840dfd could not be found. Aug 30 01:06:47.422164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3b70dfa0-6452-4cc0-8314-0a8ebf75e6fb tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Request method failure captured: Aug 30 01:06:47.422164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd HTTP/1.1 Aug 30 01:06:47.422164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:06:47.422164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:06:47.422164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:06:47.422164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:06:47.422164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:06:47.422164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:06:47.422164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:06:47.422164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:06:47.422164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWFZl1eXeWdEDlle0hI0paFtZlD2PL7IqHhMTCZh9t4-qj1yZKZ-oMZd8isPpWOq6EPoKdYey1DgasN-d057FigVzeaBK7xvIgMM59Rae3evOwrcybdKfuqMiKZ3wBQJQbTCDy7Hwhm_wrs2y5ZbRIUIowk7aEYT1BJ8gns6uC2nhJw Aug 30 01:06:47.422164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:06:47.422164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:06:47.422164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:06:47.422164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:06:47.422164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:06:47.422164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:06:47.422164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: ceebbaa5dd9d4110a6393190c5b466f0 Aug 30 01:06:47.422164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-436411527 Aug 30 01:06:47.422164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:06:47.422164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:06:47.423667 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ceebbaa5dd9d4110a6393190c5b466f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ceebbaa5dd9d4110a6393190c5b466f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ceebbaa5dd9d4110a6393190c5b466f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ceebbaa5dd9d4110a6393190c5b466f0"}]}] Aug 30 01:06:47.423667 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-ServerRescueNegativeTestJSON-436411527 Aug 30 01:06:47.423667 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: ceebbaa5dd9d4110a6393190c5b466f0 Aug 30 01:06:47.423667 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-436411527 Aug 30 01:06:47.423667 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-ServerRescueNegativeTestJSON-436411527-project Aug 30 01:06:47.423667 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:06:47.423667 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:06:47.423667 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: 5c95c8ce27fd43c6a6fe10443b6bde13 Aug 30 01:06:47.423667 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-ServerRescueNegativeTestJSON-436411527-project Aug 30 01:06:47.423667 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:06:47.423667 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Instance 377d6898-d51c-4029-b9ce-3c96e2840dfd could not be found. Aug 30 01:06:47.423667 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': '377d6898-d51c-4029-b9ce-3c96e2840dfd'} Aug 30 01:06:47.424566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:06:47.424566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:47.424566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:06:47.424566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:06:47.424566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:06:47.424566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:06:47.424566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:06:47.424566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:06:47.424566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:06:47.424566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:06:47.424566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 377d6898-d51c-4029-b9ce-3c96e2840dfd could not be found. Aug 30 01:06:47.424566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:47.424566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:47.424566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:47.424566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:47.424566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:47.424566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:47.424566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:06:47.424566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:06:47.424566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:06:47.426090 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:06:47.426090 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:06:47.426090 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:06:47.426090 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:06:47.426090 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:06:47.426090 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:06:47.426090 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:06:47.426090 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 377d6898-d51c-4029-b9ce-3c96e2840dfd could not be found. Aug 30 01:06:47.426090 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:47.426090 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:47.426090 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:47.426090 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:47.426090 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:47.426090 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:47.426090 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:06:47.426090 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:06:47.426090 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 377d6898-d51c-4029-b9ce-3c96e2840dfd could not be found. Aug 30 01:06:47.426090 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:47.427435 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3b70dfa0-6452-4cc0-8314-0a8ebf75e6fb tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Returning 404 to user: Instance 377d6898-d51c-4029-b9ce-3c96e2840dfd could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:06:47.427435 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3b70dfa0-6452-4cc0-8314-0a8ebf75e6fb tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd" status: 404 len: 111 microversion: 2.1 time: 0.031591 Aug 30 01:06:47.427435 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 323/656] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:47 2022] GET /compute/v2.1/servers/377d6898-d51c-4029-b9ce-3c96e2840dfd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:06:47.432369 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-af9773df-bd7e-4b21-bac7-bd01684f8e37 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:47.432869 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-af9773df-bd7e-4b21-bac7-bd01684f8e37 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:47.439853 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-af9773df-bd7e-4b21-bac7-bd01684f8e37 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:47.440347 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-af9773df-bd7e-4b21-bac7-bd01684f8e37 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:47.440820 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-af9773df-bd7e-4b21-bac7-bd01684f8e37 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:47.441567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-af9773df-bd7e-4b21-bac7-bd01684f8e37 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:47.442022 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-af9773df-bd7e-4b21-bac7-bd01684f8e37 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:47.442447 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-af9773df-bd7e-4b21-bac7-bd01684f8e37 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:47.467041 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-af9773df-bd7e-4b21-bac7-bd01684f8e37 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Going to try to terminate instance {{(pid=120630) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:06:47.543166 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-af9773df-bd7e-4b21-bac7-bd01684f8e37 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "DELETE /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 204 len: 0 microversion: 2.1 time: 0.114243 Aug 30 01:06:47.543682 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 334/657] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:06:47 2022] DELETE /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:06:47.552604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-8a3f4926-bd59-404e-9c2d-37ae240be076 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:47.553255 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-8a3f4926-bd59-404e-9c2d-37ae240be076 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:47.559240 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8a3f4926-bd59-404e-9c2d-37ae240be076 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:47.559723 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8a3f4926-bd59-404e-9c2d-37ae240be076 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:47.560182 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8a3f4926-bd59-404e-9c2d-37ae240be076 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:47.560864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8a3f4926-bd59-404e-9c2d-37ae240be076 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:47.561344 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8a3f4926-bd59-404e-9c2d-37ae240be076 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:47.561765 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8a3f4926-bd59-404e-9c2d-37ae240be076 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:47.579666 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=100 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:47.690155 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-8a3f4926-bd59-404e-9c2d-37ae240be076 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:47.697829 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-8a3f4926-bd59-404e-9c2d-37ae240be076 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.149062 Aug 30 01:06:47.698438 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 324/658] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:47 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:06:47.741660 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-c21835f0-27bc-40a8-a2e1-0210c35e7e58 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:47.742355 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-c21835f0-27bc-40a8-a2e1-0210c35e7e58 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:47.749520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c21835f0-27bc-40a8-a2e1-0210c35e7e58 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:47.749983 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c21835f0-27bc-40a8-a2e1-0210c35e7e58 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:47.750413 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c21835f0-27bc-40a8-a2e1-0210c35e7e58 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:47.751094 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c21835f0-27bc-40a8-a2e1-0210c35e7e58 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:47.751567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c21835f0-27bc-40a8-a2e1-0210c35e7e58 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:47.752008 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c21835f0-27bc-40a8-a2e1-0210c35e7e58 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:47.884806 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-c21835f0-27bc-40a8-a2e1-0210c35e7e58 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:47.893063 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-c21835f0-27bc-40a8-a2e1-0210c35e7e58 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2" status: 200 len: 1556 microversion: 2.1 time: 0.155677 Aug 30 01:06:47.893653 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 335/659] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:47 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:47.913961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-efabdc37-b9b2-47d7-a30e-f5dda835e8dc tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:47.914448 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-efabdc37-b9b2-47d7-a30e-f5dda835e8dc tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:47.920659 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-efabdc37-b9b2-47d7-a30e-f5dda835e8dc tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:47.921215 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-efabdc37-b9b2-47d7-a30e-f5dda835e8dc tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:47.921646 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-efabdc37-b9b2-47d7-a30e-f5dda835e8dc tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:47.922344 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-efabdc37-b9b2-47d7-a30e-f5dda835e8dc tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:47.922782 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-efabdc37-b9b2-47d7-a30e-f5dda835e8dc tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:47.923198 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-efabdc37-b9b2-47d7-a30e-f5dda835e8dc tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:47.998776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-efabdc37-b9b2-47d7-a30e-f5dda835e8dc tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088031 Aug 30 01:06:47.999361 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 325/660] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 30 01:06:47 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:48.719478 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-69c2ef1c-da69-44c8-8cd2-ffb76286c67f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:48.720084 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-69c2ef1c-da69-44c8-8cd2-ffb76286c67f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:48.725971 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-69c2ef1c-da69-44c8-8cd2-ffb76286c67f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:48.726456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-69c2ef1c-da69-44c8-8cd2-ffb76286c67f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:48.726886 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-69c2ef1c-da69-44c8-8cd2-ffb76286c67f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:48.727571 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-69c2ef1c-da69-44c8-8cd2-ffb76286c67f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:48.728023 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-69c2ef1c-da69-44c8-8cd2-ffb76286c67f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:48.728442 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-69c2ef1c-da69-44c8-8cd2-ffb76286c67f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:48.918686 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-69c2ef1c-da69-44c8-8cd2-ffb76286c67f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:48.927537 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-69c2ef1c-da69-44c8-8cd2-ffb76286c67f tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.212486 Aug 30 01:06:48.928126 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 336/661] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:48 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:49.136026 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-75855a7d-d901-460c-829b-ba1514b22589 req-e4d3c43f-6d88-4cce-8179-f43ea9410892 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d738b454-d1e4-4298-93f4-d0db045454f2", "tag": "13333188-9b10-4db5-9b32-d0a0505dcd3b"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:49.146234 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-75855a7d-d901-460c-829b-ba1514b22589 req-e4d3c43f-6d88-4cce-8179-f43ea9410892 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:49.146704 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-75855a7d-d901-460c-829b-ba1514b22589 req-e4d3c43f-6d88-4cce-8179-f43ea9410892 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:49.147132 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-75855a7d-d901-460c-829b-ba1514b22589 req-e4d3c43f-6d88-4cce-8179-f43ea9410892 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:49.157927 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-75855a7d-d901-460c-829b-ba1514b22589 req-e4d3c43f-6d88-4cce-8179-f43ea9410892 service nova] Creating event network-changed:13333188-9b10-4db5-9b32-d0a0505dcd3b for instance d738b454-d1e4-4298-93f4-d0db045454f2 on hv-cinder-81514 Aug 30 01:06:49.163059 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-75855a7d-d901-460c-829b-ba1514b22589 req-e4d3c43f-6d88-4cce-8179-f43ea9410892 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146139 Aug 30 01:06:49.163797 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 326/662] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:06:49.950563 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-15dcd9a6-22d2-4ee7-ac4b-d74d196f15ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:49.950995 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-15dcd9a6-22d2-4ee7-ac4b-d74d196f15ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:49.960605 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-15dcd9a6-22d2-4ee7-ac4b-d74d196f15ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:49.961270 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-15dcd9a6-22d2-4ee7-ac4b-d74d196f15ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:49.961713 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-15dcd9a6-22d2-4ee7-ac4b-d74d196f15ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:49.962416 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-15dcd9a6-22d2-4ee7-ac4b-d74d196f15ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:49.963282 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-15dcd9a6-22d2-4ee7-ac4b-d74d196f15ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:49.963724 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-15dcd9a6-22d2-4ee7-ac4b-d74d196f15ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:49.969531 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:50.136421 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-15dcd9a6-22d2-4ee7-ac4b-d74d196f15ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:50.144904 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-15dcd9a6-22d2-4ee7-ac4b-d74d196f15ce tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1522 microversion: 2.1 time: 0.199161 Aug 30 01:06:50.145537 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 337/663] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:49 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:50.687782 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-b9ddc079-4e51-4f13-bcb5-271ea0138497 req-1b2b5936-8c88-418f-94ba-084cd84f2d60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12338ddc-349d-4f0b-b6d8-4bb83f19e320", "name": "network-vif-deleted", "tag": "d60f2857-a480-4c65-88cc-9e8dd6a7cbf4"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:50.699739 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-b9ddc079-4e51-4f13-bcb5-271ea0138497 req-1b2b5936-8c88-418f-94ba-084cd84f2d60 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:50.700284 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-b9ddc079-4e51-4f13-bcb5-271ea0138497 req-1b2b5936-8c88-418f-94ba-084cd84f2d60 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:50.700732 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-b9ddc079-4e51-4f13-bcb5-271ea0138497 req-1b2b5936-8c88-418f-94ba-084cd84f2d60 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:50.711996 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-b9ddc079-4e51-4f13-bcb5-271ea0138497 req-1b2b5936-8c88-418f-94ba-084cd84f2d60 service nova] Creating event network-vif-deleted:d60f2857-a480-4c65-88cc-9e8dd6a7cbf4 for instance 12338ddc-349d-4f0b-b6d8-4bb83f19e320 on hv-cinder-81514 Aug 30 01:06:50.717364 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-b9ddc079-4e51-4f13-bcb5-271ea0138497 req-1b2b5936-8c88-418f-94ba-084cd84f2d60 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033312 Aug 30 01:06:50.717964 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 327/664] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:51.166929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-86430bcb-5cef-497e-ad69-24d0e827054d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:51.167526 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-86430bcb-5cef-497e-ad69-24d0e827054d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:51.175060 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-86430bcb-5cef-497e-ad69-24d0e827054d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:51.175652 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-86430bcb-5cef-497e-ad69-24d0e827054d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:51.180179 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-86430bcb-5cef-497e-ad69-24d0e827054d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:51.180892 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-86430bcb-5cef-497e-ad69-24d0e827054d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:51.181373 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-86430bcb-5cef-497e-ad69-24d0e827054d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:51.181804 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-86430bcb-5cef-497e-ad69-24d0e827054d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:51.227172 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-86430bcb-5cef-497e-ad69-24d0e827054d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:51.227576 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-86430bcb-5cef-497e-ad69-24d0e827054d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:51.228014 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-86430bcb-5cef-497e-ad69-24d0e827054d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:51.228461 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.objects.instance [None req-86430bcb-5cef-497e-ad69-24d0e827054d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lazy-loading 'fault' on Instance uuid 12338ddc-349d-4f0b-b6d8-4bb83f19e320 {{(pid=120630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:06:51.283000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-86430bcb-5cef-497e-ad69-24d0e827054d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95c8ce27fd43c6a6fe10443b6bde13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebbaa5dd9d4110a6393190c5b466f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:51.290902 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-86430bcb-5cef-497e-ad69-24d0e827054d tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 200 len: 1312 microversion: 2.1 time: 0.128166 Aug 30 01:06:51.291477 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 338/665] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:51 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 1312 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:52.315495 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-521c1565-a562-447f-8c63-5f191c3ff5c6 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:52.316196 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-521c1565-a562-447f-8c63-5f191c3ff5c6 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] [instance: 12338ddc-349d-4f0b-b6d8-4bb83f19e320] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:52.322305 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-521c1565-a562-447f-8c63-5f191c3ff5c6 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:52.322782 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-521c1565-a562-447f-8c63-5f191c3ff5c6 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:52.323217 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-521c1565-a562-447f-8c63-5f191c3ff5c6 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:52.323902 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-521c1565-a562-447f-8c63-5f191c3ff5c6 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:52.324348 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-521c1565-a562-447f-8c63-5f191c3ff5c6 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:52.324764 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-521c1565-a562-447f-8c63-5f191c3ff5c6 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:52.338443 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-521c1565-a562-447f-8c63-5f191c3ff5c6 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] HTTP exception thrown: Instance 12338ddc-349d-4f0b-b6d8-4bb83f19e320 could not be found. Aug 30 01:06:52.340024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-521c1565-a562-447f-8c63-5f191c3ff5c6 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Request method failure captured: Aug 30 01:06:52.340024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 HTTP/1.1 Aug 30 01:06:52.340024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:06:52.340024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:06:52.340024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:06:52.340024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:06:52.340024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:06:52.340024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:06:52.340024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:06:52.340024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:06:52.340024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWFZl1eXeWdEDlle0hI0paFtZlD2PL7IqHhMTCZh9t4-qj1yZKZ-oMZd8isPpWOq6EPoKdYey1DgasN-d057FigVzeaBK7xvIgMM59Rae3evOwrcybdKfuqMiKZ3wBQJQbTCDy7Hwhm_wrs2y5ZbRIUIowk7aEYT1BJ8gns6uC2nhJw Aug 30 01:06:52.340024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:06:52.340024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:06:52.340024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:06:52.340024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:06:52.340024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:06:52.340024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:06:52.340024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: ceebbaa5dd9d4110a6393190c5b466f0 Aug 30 01:06:52.340024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-436411527 Aug 30 01:06:52.340024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:06:52.340024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:06:52.341598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ceebbaa5dd9d4110a6393190c5b466f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ceebbaa5dd9d4110a6393190c5b466f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ceebbaa5dd9d4110a6393190c5b466f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ceebbaa5dd9d4110a6393190c5b466f0"}]}] Aug 30 01:06:52.341598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-ServerRescueNegativeTestJSON-436411527 Aug 30 01:06:52.341598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: ceebbaa5dd9d4110a6393190c5b466f0 Aug 30 01:06:52.341598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-436411527 Aug 30 01:06:52.341598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-ServerRescueNegativeTestJSON-436411527-project Aug 30 01:06:52.341598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:06:52.341598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:06:52.341598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: 5c95c8ce27fd43c6a6fe10443b6bde13 Aug 30 01:06:52.341598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-ServerRescueNegativeTestJSON-436411527-project Aug 30 01:06:52.341598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:06:52.341598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Instance 12338ddc-349d-4f0b-b6d8-4bb83f19e320 could not be found. Aug 30 01:06:52.341598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': '12338ddc-349d-4f0b-b6d8-4bb83f19e320'} Aug 30 01:06:52.343270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:06:52.343270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:52.343270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:06:52.343270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:06:52.343270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:06:52.343270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:06:52.343270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:06:52.343270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:06:52.343270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:06:52.343270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:06:52.343270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12338ddc-349d-4f0b-b6d8-4bb83f19e320 could not be found. Aug 30 01:06:52.343270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:52.343270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:52.343270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:52.343270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:52.343270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:52.343270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:52.343270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:06:52.343270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:06:52.343270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:06:52.345825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:06:52.345825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:06:52.345825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:06:52.345825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:06:52.345825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:06:52.345825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:06:52.345825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:06:52.345825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12338ddc-349d-4f0b-b6d8-4bb83f19e320 could not be found. Aug 30 01:06:52.345825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:52.345825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:52.345825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:52.345825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:52.345825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:52.345825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:52.345825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:06:52.345825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:06:52.345825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12338ddc-349d-4f0b-b6d8-4bb83f19e320 could not be found. Aug 30 01:06:52.345825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:52.347131 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-521c1565-a562-447f-8c63-5f191c3ff5c6 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] Returning 404 to user: Instance 12338ddc-349d-4f0b-b6d8-4bb83f19e320 could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:06:52.347131 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-521c1565-a562-447f-8c63-5f191c3ff5c6 tempest-ServerRescueNegativeTestJSON-436411527 tempest-ServerRescueNegativeTestJSON-436411527-project] 10.222.0.78 "GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320" status: 404 len: 111 microversion: 2.1 time: 0.033245 Aug 30 01:06:52.347131 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 328/666] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:52 2022] GET /compute/v2.1/servers/12338ddc-349d-4f0b-b6d8-4bb83f19e320 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:06:52.735421 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-b7fd529f-883a-4153-aae8-fe9677020650 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:52.736006 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-b7fd529f-883a-4153-aae8-fe9677020650 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:52.742494 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b7fd529f-883a-4153-aae8-fe9677020650 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:52.742983 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b7fd529f-883a-4153-aae8-fe9677020650 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:52.743422 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b7fd529f-883a-4153-aae8-fe9677020650 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:52.744117 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b7fd529f-883a-4153-aae8-fe9677020650 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:52.744569 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b7fd529f-883a-4153-aae8-fe9677020650 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:52.744993 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b7fd529f-883a-4153-aae8-fe9677020650 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:52.770489 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-b7fd529f-883a-4153-aae8-fe9677020650 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Going to try to terminate instance {{(pid=120630) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:06:52.848780 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-b7fd529f-883a-4153-aae8-fe9677020650 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 204 len: 0 microversion: 2.1 time: 0.117513 Aug 30 01:06:52.852403 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 339/667] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:06:52 2022] DELETE /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:06:52.858210 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-ecfb7ef7-3ec1-44c9-9e54-bc1aa549134a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:52.858926 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-ecfb7ef7-3ec1-44c9-9e54-bc1aa549134a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:52.865253 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ecfb7ef7-3ec1-44c9-9e54-bc1aa549134a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:52.865841 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ecfb7ef7-3ec1-44c9-9e54-bc1aa549134a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:52.866346 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ecfb7ef7-3ec1-44c9-9e54-bc1aa549134a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:52.867234 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ecfb7ef7-3ec1-44c9-9e54-bc1aa549134a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:52.867690 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ecfb7ef7-3ec1-44c9-9e54-bc1aa549134a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:52.868119 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ecfb7ef7-3ec1-44c9-9e54-bc1aa549134a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:53.002507 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-ecfb7ef7-3ec1-44c9-9e54-bc1aa549134a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:53.010242 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-ecfb7ef7-3ec1-44c9-9e54-bc1aa549134a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 200 len: 1580 microversion: 2.1 time: 0.156560 Aug 30 01:06:53.010812 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 329/668] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:52 2022] GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 1580 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:54.033886 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-57867cbd-7089-48d5-ab46-6c1b3540e4eb tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:54.034588 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-57867cbd-7089-48d5-ab46-6c1b3540e4eb tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:54.041311 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-57867cbd-7089-48d5-ab46-6c1b3540e4eb tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:54.041801 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-57867cbd-7089-48d5-ab46-6c1b3540e4eb tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:54.042236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-57867cbd-7089-48d5-ab46-6c1b3540e4eb tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:54.042943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-57867cbd-7089-48d5-ab46-6c1b3540e4eb tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:54.043393 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-57867cbd-7089-48d5-ab46-6c1b3540e4eb tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:54.044061 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-57867cbd-7089-48d5-ab46-6c1b3540e4eb tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:54.552216 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-57867cbd-7089-48d5-ab46-6c1b3540e4eb tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:54.560982 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-57867cbd-7089-48d5-ab46-6c1b3540e4eb tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 200 len: 1580 microversion: 2.1 time: 0.532724 Aug 30 01:06:54.561592 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 340/669] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:54 2022] GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 1580 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:55.584386 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0419441a-dad3-44c9-b096-3b7febee689e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:55.585005 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-0419441a-dad3-44c9-b096-3b7febee689e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:55.592780 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0419441a-dad3-44c9-b096-3b7febee689e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:55.593503 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0419441a-dad3-44c9-b096-3b7febee689e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:55.594243 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0419441a-dad3-44c9-b096-3b7febee689e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:55.594969 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0419441a-dad3-44c9-b096-3b7febee689e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:55.595426 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0419441a-dad3-44c9-b096-3b7febee689e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:55.595850 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0419441a-dad3-44c9-b096-3b7febee689e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:55.665474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-0419441a-dad3-44c9-b096-3b7febee689e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:55.679149 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-a7b3f8a7-71dc-44ee-89b4-3c68fe553e51 req-6245afd1-069c-41db-b58c-89971288692b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b85f48c2-35d7-4cab-a969-7e1b1fb4bec7", "name": "network-vif-deleted", "tag": "552a6c04-ea5e-4596-976d-aca3794998cd"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:55.686144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0419441a-dad3-44c9-b096-3b7febee689e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 200 len: 1512 microversion: 2.1 time: 0.106540 Aug 30 01:06:55.687482 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 330/670] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:55 2022] GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 1512 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:55.694321 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-a7b3f8a7-71dc-44ee-89b4-3c68fe553e51 req-6245afd1-069c-41db-b58c-89971288692b service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:55.694990 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-a7b3f8a7-71dc-44ee-89b4-3c68fe553e51 req-6245afd1-069c-41db-b58c-89971288692b service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:55.696263 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-a7b3f8a7-71dc-44ee-89b4-3c68fe553e51 req-6245afd1-069c-41db-b58c-89971288692b service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:55.723062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-a7b3f8a7-71dc-44ee-89b4-3c68fe553e51 req-6245afd1-069c-41db-b58c-89971288692b service nova] Creating event network-vif-deleted:552a6c04-ea5e-4596-976d-aca3794998cd for instance b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 on hv-cinder-81514 Aug 30 01:06:55.737980 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-a7b3f8a7-71dc-44ee-89b4-3c68fe553e51 req-6245afd1-069c-41db-b58c-89971288692b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062587 Aug 30 01:06:55.740533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 341/671] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:56.715183 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-61600b73-5e27-4231-ad95-8290b79902e8 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:56.716911 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-61600b73-5e27-4231-ad95-8290b79902e8 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:56.725315 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-61600b73-5e27-4231-ad95-8290b79902e8 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:56.726102 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-61600b73-5e27-4231-ad95-8290b79902e8 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:56.726545 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-61600b73-5e27-4231-ad95-8290b79902e8 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:56.727260 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-61600b73-5e27-4231-ad95-8290b79902e8 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:56.727894 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-61600b73-5e27-4231-ad95-8290b79902e8 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:56.736143 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-61600b73-5e27-4231-ad95-8290b79902e8 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:56.764907 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-61600b73-5e27-4231-ad95-8290b79902e8 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] HTTP exception thrown: Instance b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 could not be found. Aug 30 01:06:56.766546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-61600b73-5e27-4231-ad95-8290b79902e8 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Request method failure captured: Aug 30 01:06:56.766546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 HTTP/1.1 Aug 30 01:06:56.766546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:06:56.766546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:06:56.766546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:06:56.766546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:06:56.766546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:06:56.766546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:06:56.766546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:06:56.766546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:06:56.766546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWH5IlMs3-PpHgd-64GQoKqCaYDnstpx6kV6o3lhXrt1goFY9zuK7pTG28ziFU88vli500Zzc1_BL4IQjNvN2Nv36HyTmpwmkKHq5cZcWjPqmBgXs-ukJr77nRZfd4jHL-ffnB5cvyWaSGoqPsCJALB7h_4RB4a5CmfAV8vI5rS-xyU Aug 30 01:06:56.766546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:06:56.766546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:06:56.766546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:06:56.766546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:06:56.766546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:06:56.766546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:06:56.766546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: a6380baa172744fa9d7ba5b81f847906 Aug 30 01:06:56.766546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-TestVolumeBootPattern-1693715583 Aug 30 01:06:56.766546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:06:56.766546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:06:56.768103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a6380baa172744fa9d7ba5b81f847906"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a6380baa172744fa9d7ba5b81f847906"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a6380baa172744fa9d7ba5b81f847906"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a6380baa172744fa9d7ba5b81f847906"}]}] Aug 30 01:06:56.768103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-TestVolumeBootPattern-1693715583 Aug 30 01:06:56.768103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: a6380baa172744fa9d7ba5b81f847906 Aug 30 01:06:56.768103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-TestVolumeBootPattern-1693715583 Aug 30 01:06:56.768103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-TestVolumeBootPattern-1693715583-project Aug 30 01:06:56.768103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:06:56.768103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:06:56.768103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: d467895d586a43719d2abdf4105187f8 Aug 30 01:06:56.768103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-TestVolumeBootPattern-1693715583-project Aug 30 01:06:56.768103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:06:56.768103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Instance b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 could not be found. Aug 30 01:06:56.768103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': 'b85f48c2-35d7-4cab-a969-7e1b1fb4bec7'} Aug 30 01:06:56.768986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:06:56.768986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:56.768986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:06:56.768986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:06:56.768986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:06:56.768986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:06:56.768986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:06:56.768986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:06:56.768986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:06:56.768986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:06:56.768986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 could not be found. Aug 30 01:06:56.768986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:56.768986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:56.768986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:56.768986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:56.768986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:56.768986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:56.768986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:06:56.768986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:06:56.768986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:06:56.770403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:06:56.770403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:06:56.770403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:06:56.770403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:06:56.770403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:06:56.770403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:06:56.770403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:06:56.770403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 could not be found. Aug 30 01:06:56.770403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:56.770403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:56.770403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:56.770403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:56.770403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:56.770403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:56.770403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:06:56.770403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:06:56.770403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 could not be found. Aug 30 01:06:56.770403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:06:56.772030 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-61600b73-5e27-4231-ad95-8290b79902e8 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Returning 404 to user: Instance b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:06:56.772030 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-61600b73-5e27-4231-ad95-8290b79902e8 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 404 len: 111 microversion: 2.1 time: 0.060850 Aug 30 01:06:56.772030 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 331/672] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:56 2022] GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:06:56.889034 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-5dd52afe-52f3-4fab-87c4-7566f606d0fd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1846969709", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1418735735", "security_groups": [{"name": "tempest-secgroup-smoke-1850089549"}], "block_device_mapping_v2": [{"uuid": "8157bfa6-0403-47ba-a9da-af7a42ec22e1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9040a016-54c8-479a-991b-4e0ac5fa178d"}]}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:57.027138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.network.neutron [None req-5dd52afe-52f3-4fab-87c4-7566f606d0fd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] validate_networks() for [('9040a016-54c8-479a-991b-4e0ac5fa178d', None, None, None, None, None)] {{(pid=120630) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:06:57.424681 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-5dd52afe-52f3-4fab-87c4-7566f606d0fd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Flavor limits 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:06:57.425342 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-5dd52afe-52f3-4fab-87c4-7566f606d0fd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Image limits 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:06:57.425821 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-5dd52afe-52f3-4fab-87c4-7566f606d0fd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Flavor pref 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:06:57.426237 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-5dd52afe-52f3-4fab-87c4-7566f606d0fd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Image pref 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:06:57.426656 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-5dd52afe-52f3-4fab-87c4-7566f606d0fd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:06:57.436019 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5dd52afe-52f3-4fab-87c4-7566f606d0fd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:57.436619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5dd52afe-52f3-4fab-87c4-7566f606d0fd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:57.437112 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5dd52afe-52f3-4fab-87c4-7566f606d0fd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:57.437832 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5dd52afe-52f3-4fab-87c4-7566f606d0fd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:57.438288 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5dd52afe-52f3-4fab-87c4-7566f606d0fd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:57.438712 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5dd52afe-52f3-4fab-87c4-7566f606d0fd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:57.455561 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-5dd52afe-52f3-4fab-87c4-7566f606d0fd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Getting quotas for project a6380baa172744fa9d7ba5b81f847906. Resources: {'ram', 'instances', 'cores'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:06:57.459649 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-5dd52afe-52f3-4fab-87c4-7566f606d0fd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Getting quotas for user d467895d586a43719d2abdf4105187f8 and project a6380baa172744fa9d7ba5b81f847906. Resources: {'ram', 'instances', 'cores'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:06:57.523273 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-5dd52afe-52f3-4fab-87c4-7566f606d0fd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Going to run 1 instances... {{(pid=120630) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:06:57.525588 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-5dd52afe-52f3-4fab-87c4-7566f606d0fd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: a99c1ea6-9c8f-42ac-a6b3-6c66a025711d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8157bfa6-0403-47ba-a9da-af7a42ec22e1',volume_size=None,volume_type=None)] {{(pid=120630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:06:57.647237 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:57.668961 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-5dd52afe-52f3-4fab-87c4-7566f606d0fd tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.786214 Aug 30 01:06:57.669696 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 342/673] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 30 01:06:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:06:57.681558 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-f4ecd0dd-7060-43ae-92cb-c11b2f7918bf tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:57.682179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-f4ecd0dd-7060-43ae-92cb-c11b2f7918bf tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: a99c1ea6-9c8f-42ac-a6b3-6c66a025711d] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:57.739819 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-f4ecd0dd-7060-43ae-92cb-c11b2f7918bf tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:57.747216 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-f4ecd0dd-7060-43ae-92cb-c11b2f7918bf tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d" status: 200 len: 1095 microversion: 2.1 time: 0.070231 Aug 30 01:06:57.748061 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 332/674] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:57 2022] GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:58.769067 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-2c40535a-6688-4037-b98a-1422c7241e27 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:58.770458 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-2c40535a-6688-4037-b98a-1422c7241e27 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: a99c1ea6-9c8f-42ac-a6b3-6c66a025711d] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:58.778337 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2c40535a-6688-4037-b98a-1422c7241e27 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:58.779494 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2c40535a-6688-4037-b98a-1422c7241e27 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:58.780279 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2c40535a-6688-4037-b98a-1422c7241e27 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:58.782181 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2c40535a-6688-4037-b98a-1422c7241e27 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:58.782888 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2c40535a-6688-4037-b98a-1422c7241e27 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:58.783846 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2c40535a-6688-4037-b98a-1422c7241e27 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:58.886664 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-2c40535a-6688-4037-b98a-1422c7241e27 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:58.897523 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-2c40535a-6688-4037-b98a-1422c7241e27 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d" status: 200 len: 1193 microversion: 2.1 time: 0.132578 Aug 30 01:06:58.914409 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 343/675] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:58 2022] GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d => generated 1193 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:59.920759 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3f270c6d-c976-437b-9d3e-4605d4345ee8 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:59.921521 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-3f270c6d-c976-437b-9d3e-4605d4345ee8 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: a99c1ea6-9c8f-42ac-a6b3-6c66a025711d] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:59.935529 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3f270c6d-c976-437b-9d3e-4605d4345ee8 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:59.936033 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3f270c6d-c976-437b-9d3e-4605d4345ee8 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:59.936474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3f270c6d-c976-437b-9d3e-4605d4345ee8 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:59.937458 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3f270c6d-c976-437b-9d3e-4605d4345ee8 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:59.938788 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3f270c6d-c976-437b-9d3e-4605d4345ee8 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:59.943482 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3f270c6d-c976-437b-9d3e-4605d4345ee8 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:00.494002 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3f270c6d-c976-437b-9d3e-4605d4345ee8 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:00.499138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-aa3a4c80-cd41-4efb-9a30-f212e2af49b8 req-393519bc-3d7e-400f-a222-3ac4679fa224 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a99c1ea6-9c8f-42ac-a6b3-6c66a025711d", "tag": "c3521186-7bff-4b1d-bccf-696dc8dddb74"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:07:00.503014 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3f270c6d-c976-437b-9d3e-4605d4345ee8 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d" status: 200 len: 1267 microversion: 2.1 time: 0.587126 Aug 30 01:07:00.503868 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 333/676] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:59 2022] GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d => generated 1267 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:07:00.521957 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-aa3a4c80-cd41-4efb-9a30-f212e2af49b8 req-393519bc-3d7e-400f-a222-3ac4679fa224 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:00.522450 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-aa3a4c80-cd41-4efb-9a30-f212e2af49b8 req-393519bc-3d7e-400f-a222-3ac4679fa224 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:00.525547 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-aa3a4c80-cd41-4efb-9a30-f212e2af49b8 req-393519bc-3d7e-400f-a222-3ac4679fa224 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:00.550305 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-aa3a4c80-cd41-4efb-9a30-f212e2af49b8 req-393519bc-3d7e-400f-a222-3ac4679fa224 service nova] Creating event network-changed:c3521186-7bff-4b1d-bccf-696dc8dddb74 for instance a99c1ea6-9c8f-42ac-a6b3-6c66a025711d on hv-cinder-81514 Aug 30 01:07:00.562524 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-aa3a4c80-cd41-4efb-9a30-f212e2af49b8 req-393519bc-3d7e-400f-a222-3ac4679fa224 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067945 Aug 30 01:07:00.563586 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 344/677] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:07:01.534416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3c9ea0e3-89e9-471f-8e35-22fd4ec3cc0b tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:01.535868 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-3c9ea0e3-89e9-471f-8e35-22fd4ec3cc0b tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: a99c1ea6-9c8f-42ac-a6b3-6c66a025711d] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:01.541583 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:01.544094 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3c9ea0e3-89e9-471f-8e35-22fd4ec3cc0b tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:01.545661 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3c9ea0e3-89e9-471f-8e35-22fd4ec3cc0b tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:01.546565 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3c9ea0e3-89e9-471f-8e35-22fd4ec3cc0b tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:01.547522 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3c9ea0e3-89e9-471f-8e35-22fd4ec3cc0b tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:01.548194 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3c9ea0e3-89e9-471f-8e35-22fd4ec3cc0b tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:01.548841 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3c9ea0e3-89e9-471f-8e35-22fd4ec3cc0b tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:01.854992 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3c9ea0e3-89e9-471f-8e35-22fd4ec3cc0b tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:01.865774 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3c9ea0e3-89e9-471f-8e35-22fd4ec3cc0b tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d" status: 200 len: 1267 microversion: 2.1 time: 0.343561 Aug 30 01:07:01.866565 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 334/678] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:01 2022] GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d => generated 1267 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:07:02.568496 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-9005cc70-768f-41c0-adad-80c1d658aee2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Action: 'create', calling method: .version_select at 0x7f0f525a5790>, body: {"keypair": {"name": "tempest-keypair-690635282", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbSQys4qrN12V2sFZbQJ5mlGVn9t+9QmVl81P/vSEKdgBZ+ac645isF9b+64k9xguETaC+Mr1dJGHrqcp4IjAr0lFzUKFa7JGvHJ0MhD8XaF1eWYi79/JXtYZH0LnAosQ=="}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:07:02.584858 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-9005cc70-768f-41c0-adad-80c1d658aee2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Getting quotas for project 54768b167b1c4fefb901f640203e1c5d. Resources: {'key_pairs'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:07:02.588777 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-9005cc70-768f-41c0-adad-80c1d658aee2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Getting quotas for user 3ff0c4a8fd8d44bda56ceeb47cd49abf and project 54768b167b1c4fefb901f640203e1c5d. Resources: {'key_pairs'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:07:02.612835 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-9005cc70-768f-41c0-adad-80c1d658aee2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.181740 Aug 30 01:07:02.613526 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 345/679] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Aug 30 01:07:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 183 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 01:07:02.887044 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-dfdb06c4-4021-4729-af19-8d15aa85376e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:02.887655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-dfdb06c4-4021-4729-af19-8d15aa85376e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: a99c1ea6-9c8f-42ac-a6b3-6c66a025711d] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:02.895448 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dfdb06c4-4021-4729-af19-8d15aa85376e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:02.895936 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dfdb06c4-4021-4729-af19-8d15aa85376e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:02.896367 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dfdb06c4-4021-4729-af19-8d15aa85376e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:02.897148 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dfdb06c4-4021-4729-af19-8d15aa85376e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:02.897603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dfdb06c4-4021-4729-af19-8d15aa85376e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:02.898024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dfdb06c4-4021-4729-af19-8d15aa85376e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:03.059036 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-dfdb06c4-4021-4729-af19-8d15aa85376e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:03.070547 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-dfdb06c4-4021-4729-af19-8d15aa85376e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d" status: 200 len: 1267 microversion: 2.1 time: 0.186522 Aug 30 01:07:03.084843 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 335/680] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:02 2022] GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:07:03.980294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-618100b0-a568-4700-af1d-a12918bf2e50 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-418262778", "imageRef": "d6c817b5-c41c-4210-a963-172386e2e582", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "71657289-5845-4030-b5d1-5bad1153486f"}], "security_groups": [{"name": "tempest-securitygroup--967067783"}], "key_name": "tempest-keypair-690635282", "user_data": "}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:07:04.089535 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.network.neutron [None req-618100b0-a568-4700-af1d-a12918bf2e50 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] validate_networks() for [('71657289-5845-4030-b5d1-5bad1153486f', None, None, None, None, None)] {{(pid=120630) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:07:04.091998 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-7194fb21-b47d-47a5-9abc-15f07f6657d0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:04.092732 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-7194fb21-b47d-47a5-9abc-15f07f6657d0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: a99c1ea6-9c8f-42ac-a6b3-6c66a025711d] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:04.099577 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7194fb21-b47d-47a5-9abc-15f07f6657d0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:04.100154 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7194fb21-b47d-47a5-9abc-15f07f6657d0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:04.100686 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7194fb21-b47d-47a5-9abc-15f07f6657d0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:04.101597 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7194fb21-b47d-47a5-9abc-15f07f6657d0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:04.102130 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7194fb21-b47d-47a5-9abc-15f07f6657d0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:04.102629 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7194fb21-b47d-47a5-9abc-15f07f6657d0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:04.330175 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-7194fb21-b47d-47a5-9abc-15f07f6657d0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:04.344538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-7194fb21-b47d-47a5-9abc-15f07f6657d0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d" status: 200 len: 1267 microversion: 2.1 time: 0.256288 Aug 30 01:07:04.346145 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 336/681] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:04 2022] GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d => generated 1267 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:07:04.583653 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-618100b0-a568-4700-af1d-a12918bf2e50 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Flavor limits 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:07:04.584084 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-618100b0-a568-4700-af1d-a12918bf2e50 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Image limits 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:07:04.584559 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-618100b0-a568-4700-af1d-a12918bf2e50 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Flavor pref 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:07:04.584999 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-618100b0-a568-4700-af1d-a12918bf2e50 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Image pref 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:07:04.585435 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-618100b0-a568-4700-af1d-a12918bf2e50 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:07:04.595198 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-618100b0-a568-4700-af1d-a12918bf2e50 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:04.595765 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-618100b0-a568-4700-af1d-a12918bf2e50 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:04.596235 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-618100b0-a568-4700-af1d-a12918bf2e50 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:04.596966 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-618100b0-a568-4700-af1d-a12918bf2e50 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:04.597443 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-618100b0-a568-4700-af1d-a12918bf2e50 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:04.597874 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-618100b0-a568-4700-af1d-a12918bf2e50 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:04.615312 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-618100b0-a568-4700-af1d-a12918bf2e50 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Getting quotas for project 54768b167b1c4fefb901f640203e1c5d. Resources: {'ram', 'instances', 'cores'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:07:04.619598 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-618100b0-a568-4700-af1d-a12918bf2e50 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Getting quotas for user 3ff0c4a8fd8d44bda56ceeb47cd49abf and project 54768b167b1c4fefb901f640203e1c5d. Resources: {'ram', 'instances', 'cores'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:07:04.631186 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-618100b0-a568-4700-af1d-a12918bf2e50 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Going to run 1 instances... {{(pid=120630) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:07:04.633652 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-618100b0-a568-4700-af1d-a12918bf2e50 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6c817b5-c41c-4210-a963-172386e2e582',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:07:04.681815 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-618100b0-a568-4700-af1d-a12918bf2e50 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.706133 Aug 30 01:07:04.682816 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 346/682] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Aug 30 01:07:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 01:07:04.693885 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e997be1f-d1e9-4f71-863e-c48606e5fd09 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:04.694612 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e997be1f-d1e9-4f71-863e-c48606e5fd09 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:04.752020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e997be1f-d1e9-4f71-863e-c48606e5fd09 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:04.759735 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e997be1f-d1e9-4f71-863e-c48606e5fd09 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:04.761238 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e997be1f-d1e9-4f71-863e-c48606e5fd09 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:04.762679 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e997be1f-d1e9-4f71-863e-c48606e5fd09 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1280 microversion: 2.20 time: 0.072550 Aug 30 01:07:04.763856 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 337/683] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:07:04 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:07:05.367333 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-be3c067f-fe63-4921-9023-bfc7efd9e541 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:05.367991 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-be3c067f-fe63-4921-9023-bfc7efd9e541 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: a99c1ea6-9c8f-42ac-a6b3-6c66a025711d] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:05.376217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-be3c067f-fe63-4921-9023-bfc7efd9e541 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:05.376713 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-be3c067f-fe63-4921-9023-bfc7efd9e541 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:05.377173 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-be3c067f-fe63-4921-9023-bfc7efd9e541 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:05.377951 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-be3c067f-fe63-4921-9023-bfc7efd9e541 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:05.378414 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-be3c067f-fe63-4921-9023-bfc7efd9e541 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:05.379151 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-be3c067f-fe63-4921-9023-bfc7efd9e541 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:05.521629 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-be3c067f-fe63-4921-9023-bfc7efd9e541 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:05.530326 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-be3c067f-fe63-4921-9023-bfc7efd9e541 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d" status: 200 len: 1267 microversion: 2.1 time: 0.168098 Aug 30 01:07:05.530912 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 347/684] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:05 2022] GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:07:05.787061 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-481b67af-c32a-4c28-aeb9-4abc27a8592e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:05.787686 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-481b67af-c32a-4c28-aeb9-4abc27a8592e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:05.795730 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-481b67af-c32a-4c28-aeb9-4abc27a8592e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:05.796230 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-481b67af-c32a-4c28-aeb9-4abc27a8592e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:05.796689 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-481b67af-c32a-4c28-aeb9-4abc27a8592e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:05.797431 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-481b67af-c32a-4c28-aeb9-4abc27a8592e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:05.797884 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-481b67af-c32a-4c28-aeb9-4abc27a8592e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:05.798309 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-481b67af-c32a-4c28-aeb9-4abc27a8592e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:05.875142 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-481b67af-c32a-4c28-aeb9-4abc27a8592e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:05.889214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-481b67af-c32a-4c28-aeb9-4abc27a8592e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:05.890945 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-481b67af-c32a-4c28-aeb9-4abc27a8592e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:05.892878 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-481b67af-c32a-4c28-aeb9-4abc27a8592e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1332 microversion: 2.20 time: 0.110210 Aug 30 01:07:05.893859 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 338/685] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:07:05 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1332 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:07:06.553662 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-a659d39e-56db-4d30-a2c1-f5b773184fe1 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:06.555207 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-a659d39e-56db-4d30-a2c1-f5b773184fe1 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: a99c1ea6-9c8f-42ac-a6b3-6c66a025711d] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:06.563945 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a659d39e-56db-4d30-a2c1-f5b773184fe1 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:06.564751 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a659d39e-56db-4d30-a2c1-f5b773184fe1 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:06.566475 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a659d39e-56db-4d30-a2c1-f5b773184fe1 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:06.567363 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a659d39e-56db-4d30-a2c1-f5b773184fe1 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:06.567971 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a659d39e-56db-4d30-a2c1-f5b773184fe1 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:06.569251 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a659d39e-56db-4d30-a2c1-f5b773184fe1 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:06.735003 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-a659d39e-56db-4d30-a2c1-f5b773184fe1 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:06.744410 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-a659d39e-56db-4d30-a2c1-f5b773184fe1 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d" status: 200 len: 1267 microversion: 2.1 time: 0.196777 Aug 30 01:07:06.750979 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 348/686] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:06 2022] GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:07:06.917352 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e8b4ad4f-8f27-4690-b4b7-c097e8596cff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:06.917972 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e8b4ad4f-8f27-4690-b4b7-c097e8596cff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:06.926460 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e8b4ad4f-8f27-4690-b4b7-c097e8596cff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:06.926942 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e8b4ad4f-8f27-4690-b4b7-c097e8596cff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:06.927379 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e8b4ad4f-8f27-4690-b4b7-c097e8596cff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:06.928075 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e8b4ad4f-8f27-4690-b4b7-c097e8596cff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:06.928560 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e8b4ad4f-8f27-4690-b4b7-c097e8596cff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:06.928987 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e8b4ad4f-8f27-4690-b4b7-c097e8596cff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:07.060538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e8b4ad4f-8f27-4690-b4b7-c097e8596cff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:07.068498 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e8b4ad4f-8f27-4690-b4b7-c097e8596cff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:07.069943 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e8b4ad4f-8f27-4690-b4b7-c097e8596cff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:07.071037 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e8b4ad4f-8f27-4690-b4b7-c097e8596cff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1405 microversion: 2.20 time: 0.157703 Aug 30 01:07:07.071586 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 339/687] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:07:06 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:07:07.716030 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-2038e91c-377d-48c3-a687-1097e815a511 req-2b4abb39-be69-4a02-83b5-85d322be1ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9b5386-7fbc-4d22-a388-55c656bf9255", "tag": "f87d3a77-05ed-43ac-b192-82ed7d858c40"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:07:07.728515 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-2038e91c-377d-48c3-a687-1097e815a511 req-2b4abb39-be69-4a02-83b5-85d322be1ab5 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:07.729704 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-2038e91c-377d-48c3-a687-1097e815a511 req-2b4abb39-be69-4a02-83b5-85d322be1ab5 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:07.729917 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-2038e91c-377d-48c3-a687-1097e815a511 req-2b4abb39-be69-4a02-83b5-85d322be1ab5 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:07.742752 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-2038e91c-377d-48c3-a687-1097e815a511 req-2b4abb39-be69-4a02-83b5-85d322be1ab5 service nova] Creating event network-changed:f87d3a77-05ed-43ac-b192-82ed7d858c40 for instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 on hv-cinder-81514 Aug 30 01:07:07.749147 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-2038e91c-377d-48c3-a687-1097e815a511 req-2b4abb39-be69-4a02-83b5-85d322be1ab5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037422 Aug 30 01:07:07.750093 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 349/688] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:07.765987 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-2e76d39a-ee2d-47b0-9e54-7e8aa480f139 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:07.766592 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-2e76d39a-ee2d-47b0-9e54-7e8aa480f139 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: a99c1ea6-9c8f-42ac-a6b3-6c66a025711d] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:07.773412 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2e76d39a-ee2d-47b0-9e54-7e8aa480f139 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:07.773900 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2e76d39a-ee2d-47b0-9e54-7e8aa480f139 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:07.774330 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2e76d39a-ee2d-47b0-9e54-7e8aa480f139 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:07.775029 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2e76d39a-ee2d-47b0-9e54-7e8aa480f139 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:07.775475 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2e76d39a-ee2d-47b0-9e54-7e8aa480f139 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:07.775896 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2e76d39a-ee2d-47b0-9e54-7e8aa480f139 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:07.933638 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-2e76d39a-ee2d-47b0-9e54-7e8aa480f139 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:07.944457 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-2e76d39a-ee2d-47b0-9e54-7e8aa480f139 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d" status: 200 len: 1267 microversion: 2.1 time: 0.181236 Aug 30 01:07:07.946714 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 340/689] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:07 2022] GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:07:08.096762 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-bb87ee2f-5d4c-4c5d-b97d-fd09572bffd6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:08.097548 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-bb87ee2f-5d4c-4c5d-b97d-fd09572bffd6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:08.104149 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bb87ee2f-5d4c-4c5d-b97d-fd09572bffd6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:08.104637 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bb87ee2f-5d4c-4c5d-b97d-fd09572bffd6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:08.105843 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bb87ee2f-5d4c-4c5d-b97d-fd09572bffd6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:08.105843 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bb87ee2f-5d4c-4c5d-b97d-fd09572bffd6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:08.106334 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bb87ee2f-5d4c-4c5d-b97d-fd09572bffd6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:08.107520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bb87ee2f-5d4c-4c5d-b97d-fd09572bffd6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:08.268894 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-bb87ee2f-5d4c-4c5d-b97d-fd09572bffd6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:08.279666 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-bb87ee2f-5d4c-4c5d-b97d-fd09572bffd6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:08.281306 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-bb87ee2f-5d4c-4c5d-b97d-fd09572bffd6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:08.282434 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-bb87ee2f-5d4c-4c5d-b97d-fd09572bffd6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1405 microversion: 2.20 time: 0.191961 Aug 30 01:07:08.283279 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 350/690] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:07:08 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:07:08.968625 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-df35b5c1-97e1-4e79-b716-3ad6219b98eb tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:08.969269 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-df35b5c1-97e1-4e79-b716-3ad6219b98eb tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: a99c1ea6-9c8f-42ac-a6b3-6c66a025711d] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:08.975600 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-df35b5c1-97e1-4e79-b716-3ad6219b98eb tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:08.976086 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-df35b5c1-97e1-4e79-b716-3ad6219b98eb tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:08.976523 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-df35b5c1-97e1-4e79-b716-3ad6219b98eb tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:08.977244 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-df35b5c1-97e1-4e79-b716-3ad6219b98eb tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:08.977698 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-df35b5c1-97e1-4e79-b716-3ad6219b98eb tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:08.978124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-df35b5c1-97e1-4e79-b716-3ad6219b98eb tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:09.107481 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-df35b5c1-97e1-4e79-b716-3ad6219b98eb tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:09.115134 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-df35b5c1-97e1-4e79-b716-3ad6219b98eb tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d" status: 200 len: 1267 microversion: 2.1 time: 0.151561 Aug 30 01:07:09.115699 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 341/691] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:08 2022] GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:07:09.305763 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-1c37cc75-65c3-42e5-945a-6544d8bad5f0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:09.306325 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-1c37cc75-65c3-42e5-945a-6544d8bad5f0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:09.313460 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1c37cc75-65c3-42e5-945a-6544d8bad5f0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:09.313954 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1c37cc75-65c3-42e5-945a-6544d8bad5f0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:09.314394 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1c37cc75-65c3-42e5-945a-6544d8bad5f0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:09.315092 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1c37cc75-65c3-42e5-945a-6544d8bad5f0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:09.315546 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1c37cc75-65c3-42e5-945a-6544d8bad5f0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:09.315973 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1c37cc75-65c3-42e5-945a-6544d8bad5f0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:09.452446 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-1c37cc75-65c3-42e5-945a-6544d8bad5f0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:09.460548 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-1c37cc75-65c3-42e5-945a-6544d8bad5f0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:09.462005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-1c37cc75-65c3-42e5-945a-6544d8bad5f0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:09.463108 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-1c37cc75-65c3-42e5-945a-6544d8bad5f0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1405 microversion: 2.20 time: 0.161353 Aug 30 01:07:09.463668 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 351/692] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:07:09 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:07:10.135790 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-bc4c325b-11b0-45d0-aa64-d8de750420f5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:10.136585 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-bc4c325b-11b0-45d0-aa64-d8de750420f5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: a99c1ea6-9c8f-42ac-a6b3-6c66a025711d] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:10.144110 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-bc4c325b-11b0-45d0-aa64-d8de750420f5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:10.144602 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-bc4c325b-11b0-45d0-aa64-d8de750420f5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:10.145036 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-bc4c325b-11b0-45d0-aa64-d8de750420f5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:10.145757 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-bc4c325b-11b0-45d0-aa64-d8de750420f5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:10.146238 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-bc4c325b-11b0-45d0-aa64-d8de750420f5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:10.146692 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-bc4c325b-11b0-45d0-aa64-d8de750420f5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:10.259794 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-471004a1-4a17-486c-a08c-d034ed4b13d9 req-42494f91-c8cc-4c5d-b41c-43d8997f0d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99c1ea6-9c8f-42ac-a6b3-6c66a025711d", "name": "network-vif-plugged", "status": "completed", "tag": "c3521186-7bff-4b1d-bccf-696dc8dddb74"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:07:10.269900 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-471004a1-4a17-486c-a08c-d034ed4b13d9 req-42494f91-c8cc-4c5d-b41c-43d8997f0d2d service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:10.270381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-471004a1-4a17-486c-a08c-d034ed4b13d9 req-42494f91-c8cc-4c5d-b41c-43d8997f0d2d service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:10.270807 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-471004a1-4a17-486c-a08c-d034ed4b13d9 req-42494f91-c8cc-4c5d-b41c-43d8997f0d2d service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:10.285824 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-471004a1-4a17-486c-a08c-d034ed4b13d9 req-42494f91-c8cc-4c5d-b41c-43d8997f0d2d service nova] Creating event network-vif-plugged:c3521186-7bff-4b1d-bccf-696dc8dddb74 for instance a99c1ea6-9c8f-42ac-a6b3-6c66a025711d on hv-cinder-81514 Aug 30 01:07:10.290788 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-471004a1-4a17-486c-a08c-d034ed4b13d9 req-42494f91-c8cc-4c5d-b41c-43d8997f0d2d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096773 Aug 30 01:07:10.291696 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 352/693] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:07:10.311020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-bc4c325b-11b0-45d0-aa64-d8de750420f5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:10.319272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-bc4c325b-11b0-45d0-aa64-d8de750420f5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d" status: 200 len: 1267 microversion: 2.1 time: 0.187277 Aug 30 01:07:10.319856 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 342/694] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:10 2022] GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:07:10.486591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-fc2954d7-a9fb-42d2-b66f-611555989266 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:10.487202 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-fc2954d7-a9fb-42d2-b66f-611555989266 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:10.493436 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fc2954d7-a9fb-42d2-b66f-611555989266 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:10.493927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fc2954d7-a9fb-42d2-b66f-611555989266 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:10.494366 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fc2954d7-a9fb-42d2-b66f-611555989266 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:10.495060 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fc2954d7-a9fb-42d2-b66f-611555989266 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:10.495513 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fc2954d7-a9fb-42d2-b66f-611555989266 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:10.495938 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fc2954d7-a9fb-42d2-b66f-611555989266 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:10.635901 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-fc2954d7-a9fb-42d2-b66f-611555989266 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:10.644811 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-fc2954d7-a9fb-42d2-b66f-611555989266 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:10.646344 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-fc2954d7-a9fb-42d2-b66f-611555989266 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:10.647464 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-fc2954d7-a9fb-42d2-b66f-611555989266 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1405 microversion: 2.20 time: 0.166350 Aug 30 01:07:10.648025 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 353/695] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:07:10 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:07:11.340015 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-622b6664-5d7e-4cc5-a421-fd297bee91b0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:11.340655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-622b6664-5d7e-4cc5-a421-fd297bee91b0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: a99c1ea6-9c8f-42ac-a6b3-6c66a025711d] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:11.347271 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-622b6664-5d7e-4cc5-a421-fd297bee91b0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:11.347748 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-622b6664-5d7e-4cc5-a421-fd297bee91b0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:11.348178 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-622b6664-5d7e-4cc5-a421-fd297bee91b0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:11.348861 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-622b6664-5d7e-4cc5-a421-fd297bee91b0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:11.349344 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-622b6664-5d7e-4cc5-a421-fd297bee91b0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:11.349765 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-622b6664-5d7e-4cc5-a421-fd297bee91b0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:11.482946 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-622b6664-5d7e-4cc5-a421-fd297bee91b0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:11.490484 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-622b6664-5d7e-4cc5-a421-fd297bee91b0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d" status: 200 len: 1267 microversion: 2.1 time: 0.154591 Aug 30 01:07:11.491044 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 343/696] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:11 2022] GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:07:11.670189 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-ab8b4f15-7894-4bfb-b8c9-daf24a4f44f2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:11.670795 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-ab8b4f15-7894-4bfb-b8c9-daf24a4f44f2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:11.677210 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ab8b4f15-7894-4bfb-b8c9-daf24a4f44f2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:11.677701 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ab8b4f15-7894-4bfb-b8c9-daf24a4f44f2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:11.678141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ab8b4f15-7894-4bfb-b8c9-daf24a4f44f2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:11.678836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ab8b4f15-7894-4bfb-b8c9-daf24a4f44f2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:11.679291 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ab8b4f15-7894-4bfb-b8c9-daf24a4f44f2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:11.679722 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ab8b4f15-7894-4bfb-b8c9-daf24a4f44f2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:11.816452 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-ab8b4f15-7894-4bfb-b8c9-daf24a4f44f2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:11.824395 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-ab8b4f15-7894-4bfb-b8c9-daf24a4f44f2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:11.826022 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-ab8b4f15-7894-4bfb-b8c9-daf24a4f44f2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:11.827132 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-ab8b4f15-7894-4bfb-b8c9-daf24a4f44f2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1405 microversion: 2.20 time: 0.160987 Aug 30 01:07:11.827675 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 354/697] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:07:11 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:07:12.306532 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-d33edb4c-0847-480b-bd62-47cad931d1f8 req-969653e2-afa3-4c6c-9476-b734d99c4ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9b5386-7fbc-4d22-a388-55c656bf9255", "name": "network-vif-plugged", "status": "completed", "tag": "f87d3a77-05ed-43ac-b192-82ed7d858c40"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:07:12.316649 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-d33edb4c-0847-480b-bd62-47cad931d1f8 req-969653e2-afa3-4c6c-9476-b734d99c4ba4 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:12.317149 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-d33edb4c-0847-480b-bd62-47cad931d1f8 req-969653e2-afa3-4c6c-9476-b734d99c4ba4 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:12.317584 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-d33edb4c-0847-480b-bd62-47cad931d1f8 req-969653e2-afa3-4c6c-9476-b734d99c4ba4 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:12.328162 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-d33edb4c-0847-480b-bd62-47cad931d1f8 req-969653e2-afa3-4c6c-9476-b734d99c4ba4 service nova] Creating event network-vif-plugged:f87d3a77-05ed-43ac-b192-82ed7d858c40 for instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 on hv-cinder-81514 Aug 30 01:07:12.333164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-d33edb4c-0847-480b-bd62-47cad931d1f8 req-969653e2-afa3-4c6c-9476-b734d99c4ba4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030319 Aug 30 01:07:12.333730 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 344/698] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:12.513506 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-7c515bc5-6c21-40c7-b111-9fb2f0a1c15b tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:12.514195 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-7c515bc5-6c21-40c7-b111-9fb2f0a1c15b tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: a99c1ea6-9c8f-42ac-a6b3-6c66a025711d] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:12.520500 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c515bc5-6c21-40c7-b111-9fb2f0a1c15b tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:12.521095 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c515bc5-6c21-40c7-b111-9fb2f0a1c15b tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:12.521543 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c515bc5-6c21-40c7-b111-9fb2f0a1c15b tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:12.522242 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c515bc5-6c21-40c7-b111-9fb2f0a1c15b tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:12.522687 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c515bc5-6c21-40c7-b111-9fb2f0a1c15b tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:12.523109 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c515bc5-6c21-40c7-b111-9fb2f0a1c15b tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:12.652329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7c515bc5-6c21-40c7-b111-9fb2f0a1c15b tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:12.661343 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-7c515bc5-6c21-40c7-b111-9fb2f0a1c15b tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d" status: 200 len: 1455 microversion: 2.1 time: 0.154124 Aug 30 01:07:12.661917 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 355/699] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:12 2022] GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d => generated 1455 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:07:12.682262 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3730399b-1be4-427d-a082-d7e7c23f92ab tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:12.682958 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-3730399b-1be4-427d-a082-d7e7c23f92ab tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: a99c1ea6-9c8f-42ac-a6b3-6c66a025711d] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:12.689910 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3730399b-1be4-427d-a082-d7e7c23f92ab tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:12.690397 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3730399b-1be4-427d-a082-d7e7c23f92ab tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:12.690836 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3730399b-1be4-427d-a082-d7e7c23f92ab tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:12.691528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3730399b-1be4-427d-a082-d7e7c23f92ab tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:12.691986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3730399b-1be4-427d-a082-d7e7c23f92ab tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:12.692410 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3730399b-1be4-427d-a082-d7e7c23f92ab tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:12.823645 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3730399b-1be4-427d-a082-d7e7c23f92ab tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:12.831621 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3730399b-1be4-427d-a082-d7e7c23f92ab tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d" status: 200 len: 1455 microversion: 2.1 time: 0.153919 Aug 30 01:07:12.832192 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 345/700] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:12 2022] GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d => generated 1455 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:07:12.849464 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-21b36b22-633a-4219-9c0d-149617156016 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:12.850080 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-21b36b22-633a-4219-9c0d-149617156016 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:12.857547 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-21b36b22-633a-4219-9c0d-149617156016 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:12.858290 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-21b36b22-633a-4219-9c0d-149617156016 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:12.859226 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-21b36b22-633a-4219-9c0d-149617156016 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:12.859439 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-21b36b22-633a-4219-9c0d-149617156016 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:12.859890 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-21b36b22-633a-4219-9c0d-149617156016 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:12.860315 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-21b36b22-633a-4219-9c0d-149617156016 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:13.000007 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-21b36b22-633a-4219-9c0d-149617156016 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:13.003561 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:13.009294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-21b36b22-633a-4219-9c0d-149617156016 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:13.010760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-21b36b22-633a-4219-9c0d-149617156016 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:13.011872 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-21b36b22-633a-4219-9c0d-149617156016 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1405 microversion: 2.20 time: 0.166574 Aug 30 01:07:13.013196 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 356/701] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:07:12 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:07:14.035343 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-9598f957-ff98-4657-9ba8-a225ac20d91d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:14.035949 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-9598f957-ff98-4657-9ba8-a225ac20d91d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:14.044248 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9598f957-ff98-4657-9ba8-a225ac20d91d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:14.044780 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9598f957-ff98-4657-9ba8-a225ac20d91d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:14.045194 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9598f957-ff98-4657-9ba8-a225ac20d91d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:14.045896 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9598f957-ff98-4657-9ba8-a225ac20d91d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:14.046380 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9598f957-ff98-4657-9ba8-a225ac20d91d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:14.046795 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9598f957-ff98-4657-9ba8-a225ac20d91d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:14.193704 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-9598f957-ff98-4657-9ba8-a225ac20d91d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:14.197686 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=100 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:14.204638 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-9598f957-ff98-4657-9ba8-a225ac20d91d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:14.205976 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-9598f957-ff98-4657-9ba8-a225ac20d91d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:14.207367 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-9598f957-ff98-4657-9ba8-a225ac20d91d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1405 microversion: 2.20 time: 0.176314 Aug 30 01:07:14.220825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 346/702] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:07:14 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1405 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:07:14.661212 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-683179cb-8e05-47b3-bf0e-c652557704da req-acb89fc0-0dd3-46f0-9d7d-dabf3b18a0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a99c1ea6-9c8f-42ac-a6b3-6c66a025711d", "tag": "c3521186-7bff-4b1d-bccf-696dc8dddb74"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:07:14.666870 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=4 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:14.667535 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=16 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:14.674498 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-683179cb-8e05-47b3-bf0e-c652557704da req-acb89fc0-0dd3-46f0-9d7d-dabf3b18a0b8 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:14.674978 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-683179cb-8e05-47b3-bf0e-c652557704da req-acb89fc0-0dd3-46f0-9d7d-dabf3b18a0b8 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:14.675410 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-683179cb-8e05-47b3-bf0e-c652557704da req-acb89fc0-0dd3-46f0-9d7d-dabf3b18a0b8 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:14.687205 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-683179cb-8e05-47b3-bf0e-c652557704da req-acb89fc0-0dd3-46f0-9d7d-dabf3b18a0b8 service nova] Creating event network-changed:c3521186-7bff-4b1d-bccf-696dc8dddb74 for instance a99c1ea6-9c8f-42ac-a6b3-6c66a025711d on hv-cinder-81514 Aug 30 01:07:14.692058 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-683179cb-8e05-47b3-bf0e-c652557704da req-acb89fc0-0dd3-46f0-9d7d-dabf3b18a0b8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034789 Aug 30 01:07:14.692655 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 357/703] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:15.232809 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-99d802b1-c84c-407d-9a85-229469e65fc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:15.233332 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-99d802b1-c84c-407d-9a85-229469e65fc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:15.236364 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=4 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:15.251478 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-99d802b1-c84c-407d-9a85-229469e65fc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:15.251973 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-99d802b1-c84c-407d-9a85-229469e65fc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:15.252410 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-99d802b1-c84c-407d-9a85-229469e65fc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:15.253151 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-99d802b1-c84c-407d-9a85-229469e65fc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:15.253604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-99d802b1-c84c-407d-9a85-229469e65fc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:15.254025 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-99d802b1-c84c-407d-9a85-229469e65fc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:15.398928 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-99d802b1-c84c-407d-9a85-229469e65fc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:15.407366 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-99d802b1-c84c-407d-9a85-229469e65fc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:15.409194 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-99d802b1-c84c-407d-9a85-229469e65fc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:15.410423 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-99d802b1-c84c-407d-9a85-229469e65fc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1597 microversion: 2.20 time: 0.182269 Aug 30 01:07:15.411058 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 347/704] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:07:15 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1597 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:07:15.433455 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-c114ce65-ac9a-4c8e-b29e-fd47697cf410 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:15.434835 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-c114ce65-ac9a-4c8e-b29e-fd47697cf410 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:15.441352 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c114ce65-ac9a-4c8e-b29e-fd47697cf410 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:15.441838 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c114ce65-ac9a-4c8e-b29e-fd47697cf410 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:15.442274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c114ce65-ac9a-4c8e-b29e-fd47697cf410 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:15.442971 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c114ce65-ac9a-4c8e-b29e-fd47697cf410 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:15.443423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c114ce65-ac9a-4c8e-b29e-fd47697cf410 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:15.443847 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c114ce65-ac9a-4c8e-b29e-fd47697cf410 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:15.524971 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-c114ce65-ac9a-4c8e-b29e-fd47697cf410 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095818 Aug 30 01:07:15.525623 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 358/705] 10.222.0.78 () {60 vars in 1316 bytes} [Tue Aug 30 01:07:15 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:07:16.706972 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-e93ef4d7-d294-48ff-a045-34e3bbcc1626 req-bd61f762-d2f6-402b-b578-ad0eb9b4bcdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9b5386-7fbc-4d22-a388-55c656bf9255", "tag": "f87d3a77-05ed-43ac-b192-82ed7d858c40"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:07:16.717116 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-e93ef4d7-d294-48ff-a045-34e3bbcc1626 req-bd61f762-d2f6-402b-b578-ad0eb9b4bcdd service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:16.717573 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-e93ef4d7-d294-48ff-a045-34e3bbcc1626 req-bd61f762-d2f6-402b-b578-ad0eb9b4bcdd service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:16.717996 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-e93ef4d7-d294-48ff-a045-34e3bbcc1626 req-bd61f762-d2f6-402b-b578-ad0eb9b4bcdd service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:16.728959 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-e93ef4d7-d294-48ff-a045-34e3bbcc1626 req-bd61f762-d2f6-402b-b578-ad0eb9b4bcdd service nova] Creating event network-changed:f87d3a77-05ed-43ac-b192-82ed7d858c40 for instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 on hv-cinder-81514 Aug 30 01:07:16.734423 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-e93ef4d7-d294-48ff-a045-34e3bbcc1626 req-bd61f762-d2f6-402b-b578-ad0eb9b4bcdd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031166 Aug 30 01:07:16.735014 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 348/706] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:26.946266 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:26.947021 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=6 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:26.951543 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-185b6c96-b3cb-4869-94ab-d18da8d9d1c0 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:26.952038 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-185b6c96-b3cb-4869-94ab-d18da8d9d1c0 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:26.959192 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-185b6c96-b3cb-4869-94ab-d18da8d9d1c0 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:26.959676 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-185b6c96-b3cb-4869-94ab-d18da8d9d1c0 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:26.960125 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-185b6c96-b3cb-4869-94ab-d18da8d9d1c0 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:26.960810 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-185b6c96-b3cb-4869-94ab-d18da8d9d1c0 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:26.961336 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-185b6c96-b3cb-4869-94ab-d18da8d9d1c0 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:26.961765 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-185b6c96-b3cb-4869-94ab-d18da8d9d1c0 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:26.986106 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-185b6c96-b3cb-4869-94ab-d18da8d9d1c0 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2/ips" status: 200 len: 149 microversion: 2.1 time: 0.041542 Aug 30 01:07:26.986673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 359/707] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 30 01:07:26 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:27.530655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=31 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:27.531393 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=8 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:27.536173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-8f32dd2b-a58d-4b6d-baff-35dcbe8dae88 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:27.536742 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-8f32dd2b-a58d-4b6d-baff-35dcbe8dae88 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:27.543476 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f32dd2b-a58d-4b6d-baff-35dcbe8dae88 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:27.543948 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f32dd2b-a58d-4b6d-baff-35dcbe8dae88 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:27.544377 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f32dd2b-a58d-4b6d-baff-35dcbe8dae88 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:27.545060 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f32dd2b-a58d-4b6d-baff-35dcbe8dae88 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:27.545553 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f32dd2b-a58d-4b6d-baff-35dcbe8dae88 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:27.545971 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8f32dd2b-a58d-4b6d-baff-35dcbe8dae88 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:27.569616 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-8f32dd2b-a58d-4b6d-baff-35dcbe8dae88 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/ips" status: 200 len: 146 microversion: 2.1 time: 0.040460 Aug 30 01:07:27.570235 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 349/708] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 30 01:07:27 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:28.313223 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-85ed1327-9e62-4e9a-bef7-c089ad1404da tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90530d42-72d7-4fd0-95f6-a480eff557f7"}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:07:28.315526 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-85ed1327-9e62-4e9a-bef7-c089ad1404da tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:28.321965 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-85ed1327-9e62-4e9a-bef7-c089ad1404da tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:28.322449 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-85ed1327-9e62-4e9a-bef7-c089ad1404da tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:28.322927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-85ed1327-9e62-4e9a-bef7-c089ad1404da tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:28.323594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-85ed1327-9e62-4e9a-bef7-c089ad1404da tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:28.324043 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-85ed1327-9e62-4e9a-bef7-c089ad1404da tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:28.325134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-85ed1327-9e62-4e9a-bef7-c089ad1404da tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:28.589050 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-85ed1327-9e62-4e9a-bef7-c089ad1404da tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "POST /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279791 Aug 30 01:07:28.589691 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 360/709] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 30 01:07:28 2022] POST /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:28.918234 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-205d6fbe-c45f-4114-9912-7f8a69708e5e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27c68783-6059-4719-8476-d5457fa12248"}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:07:28.920796 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-205d6fbe-c45f-4114-9912-7f8a69708e5e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:28.927135 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-205d6fbe-c45f-4114-9912-7f8a69708e5e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:28.927623 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-205d6fbe-c45f-4114-9912-7f8a69708e5e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:28.928063 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-205d6fbe-c45f-4114-9912-7f8a69708e5e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:28.928758 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-205d6fbe-c45f-4114-9912-7f8a69708e5e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:28.929254 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-205d6fbe-c45f-4114-9912-7f8a69708e5e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:28.929680 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-205d6fbe-c45f-4114-9912-7f8a69708e5e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:29.179349 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-205d6fbe-c45f-4114-9912-7f8a69708e5e tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "POST /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265102 Aug 30 01:07:29.180143 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 350/710] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 30 01:07:28 2022] POST /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:36.221643 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-b7cdb898-1481-49d5-9756-783813956579 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:36.222226 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-b7cdb898-1481-49d5-9756-783813956579 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:36.228380 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b7cdb898-1481-49d5-9756-783813956579 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:36.228861 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b7cdb898-1481-49d5-9756-783813956579 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:36.229329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b7cdb898-1481-49d5-9756-783813956579 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:36.230015 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b7cdb898-1481-49d5-9756-783813956579 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:36.230465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b7cdb898-1481-49d5-9756-783813956579 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:36.230888 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b7cdb898-1481-49d5-9756-783813956579 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:36.312866 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.objects.instance [None req-b7cdb898-1481-49d5-9756-783813956579 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lazy-loading 'services' on Instance uuid d738b454-d1e4-4298-93f4-d0db045454f2 {{(pid=120630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:07:36.383650 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-b7cdb898-1481-49d5-9756-783813956579 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2/os-volume_attachments/90530d42-72d7-4fd0-95f6-a480eff557f7" status: 202 len: 0 microversion: 2.1 time: 0.167469 Aug 30 01:07:36.384235 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 361/711] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 30 01:07:36 2022] DELETE /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2/os-volume_attachments/90530d42-72d7-4fd0-95f6-a480eff557f7 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:07:36.394941 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e966deff-01fb-4f19-afa7-cbcd7f355403 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:36.397439 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e966deff-01fb-4f19-afa7-cbcd7f355403 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:36.404671 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e966deff-01fb-4f19-afa7-cbcd7f355403 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:36.405354 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e966deff-01fb-4f19-afa7-cbcd7f355403 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:36.405952 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e966deff-01fb-4f19-afa7-cbcd7f355403 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:36.407007 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e966deff-01fb-4f19-afa7-cbcd7f355403 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:36.407494 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e966deff-01fb-4f19-afa7-cbcd7f355403 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:36.407923 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e966deff-01fb-4f19-afa7-cbcd7f355403 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:36.443671 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e966deff-01fb-4f19-afa7-cbcd7f355403 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054254 Aug 30 01:07:36.444226 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 351/712] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:07:36 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:37.457540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4c919cbd-801b-4d19-931a-cae3fd7d7cfa tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:37.459883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-4c919cbd-801b-4d19-931a-cae3fd7d7cfa tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:37.468243 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c919cbd-801b-4d19-931a-cae3fd7d7cfa tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:37.468729 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c919cbd-801b-4d19-931a-cae3fd7d7cfa tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:37.469231 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c919cbd-801b-4d19-931a-cae3fd7d7cfa tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:37.469983 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c919cbd-801b-4d19-931a-cae3fd7d7cfa tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:37.470435 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c919cbd-801b-4d19-931a-cae3fd7d7cfa tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:37.470893 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4c919cbd-801b-4d19-931a-cae3fd7d7cfa tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:37.502167 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-4c919cbd-801b-4d19-931a-cae3fd7d7cfa tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049627 Aug 30 01:07:37.502720 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 362/713] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:07:37 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:38.513762 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e078ba8b-90e0-4085-89d8-61bf063f3ebe tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:38.515808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e078ba8b-90e0-4085-89d8-61bf063f3ebe tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:38.522533 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e078ba8b-90e0-4085-89d8-61bf063f3ebe tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:38.522985 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e078ba8b-90e0-4085-89d8-61bf063f3ebe tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:38.523410 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e078ba8b-90e0-4085-89d8-61bf063f3ebe tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:38.524089 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e078ba8b-90e0-4085-89d8-61bf063f3ebe tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:38.524536 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e078ba8b-90e0-4085-89d8-61bf063f3ebe tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:38.524954 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e078ba8b-90e0-4085-89d8-61bf063f3ebe tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:38.554873 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e078ba8b-90e0-4085-89d8-61bf063f3ebe tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045353 Aug 30 01:07:38.555409 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 352/714] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:07:38 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:39.568654 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-3e8a38a5-7458-45b2-93f4-998ac5b79d91 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:39.570738 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-3e8a38a5-7458-45b2-93f4-998ac5b79d91 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:39.577943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3e8a38a5-7458-45b2-93f4-998ac5b79d91 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:39.578427 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3e8a38a5-7458-45b2-93f4-998ac5b79d91 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:39.578859 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3e8a38a5-7458-45b2-93f4-998ac5b79d91 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:39.579551 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3e8a38a5-7458-45b2-93f4-998ac5b79d91 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:39.579994 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3e8a38a5-7458-45b2-93f4-998ac5b79d91 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:39.580412 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3e8a38a5-7458-45b2-93f4-998ac5b79d91 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:39.611743 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-3e8a38a5-7458-45b2-93f4-998ac5b79d91 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047056 Aug 30 01:07:39.612306 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 363/715] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:07:39 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:40.624861 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-d7c06a4e-f5db-4e07-97ce-8f3a8385ffea tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:40.627025 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-d7c06a4e-f5db-4e07-97ce-8f3a8385ffea tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:40.633556 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d7c06a4e-f5db-4e07-97ce-8f3a8385ffea tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:40.634126 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d7c06a4e-f5db-4e07-97ce-8f3a8385ffea tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:40.634561 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d7c06a4e-f5db-4e07-97ce-8f3a8385ffea tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:40.635264 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d7c06a4e-f5db-4e07-97ce-8f3a8385ffea tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:40.635714 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d7c06a4e-f5db-4e07-97ce-8f3a8385ffea tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:40.636139 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d7c06a4e-f5db-4e07-97ce-8f3a8385ffea tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:40.667770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-d7c06a4e-f5db-4e07-97ce-8f3a8385ffea tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047601 Aug 30 01:07:40.668362 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 353/716] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:07:40 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:41.680943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-988546f1-9365-447f-a9f7-b7944c138ae6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:41.683100 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-988546f1-9365-447f-a9f7-b7944c138ae6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:41.690660 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-988546f1-9365-447f-a9f7-b7944c138ae6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:41.691244 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-988546f1-9365-447f-a9f7-b7944c138ae6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:41.691895 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-988546f1-9365-447f-a9f7-b7944c138ae6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:41.692592 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-988546f1-9365-447f-a9f7-b7944c138ae6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:41.693041 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-988546f1-9365-447f-a9f7-b7944c138ae6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:41.693490 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-988546f1-9365-447f-a9f7-b7944c138ae6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:41.723131 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-988546f1-9365-447f-a9f7-b7944c138ae6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046698 Aug 30 01:07:41.723717 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 364/717] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:07:41 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:42.022510 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-05fcbdab-c346-4c7c-9f4c-375ff3ec6ca5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:42.024662 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-05fcbdab-c346-4c7c-9f4c-375ff3ec6ca5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:42.031448 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-05fcbdab-c346-4c7c-9f4c-375ff3ec6ca5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:42.032278 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-05fcbdab-c346-4c7c-9f4c-375ff3ec6ca5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:42.032721 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-05fcbdab-c346-4c7c-9f4c-375ff3ec6ca5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:42.033570 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-05fcbdab-c346-4c7c-9f4c-375ff3ec6ca5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:42.034031 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-05fcbdab-c346-4c7c-9f4c-375ff3ec6ca5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:42.037226 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-05fcbdab-c346-4c7c-9f4c-375ff3ec6ca5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:42.066139 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-05fcbdab-c346-4c7c-9f4c-375ff3ec6ca5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047600 Aug 30 01:07:42.066591 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 354/718] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:07:42 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:42.078079 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-7c598956-fc16-4f5e-8c5c-7080e55f030f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:42.078607 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-7c598956-fc16-4f5e-8c5c-7080e55f030f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:42.084454 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c598956-fc16-4f5e-8c5c-7080e55f030f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:42.084948 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c598956-fc16-4f5e-8c5c-7080e55f030f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:42.085431 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c598956-fc16-4f5e-8c5c-7080e55f030f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:42.086131 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c598956-fc16-4f5e-8c5c-7080e55f030f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:42.086592 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c598956-fc16-4f5e-8c5c-7080e55f030f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:42.087020 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c598956-fc16-4f5e-8c5c-7080e55f030f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:42.118895 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-7c598956-fc16-4f5e-8c5c-7080e55f030f tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-volume_attachments/27c68783-6059-4719-8476-d5457fa12248" status: 200 len: 194 microversion: 2.1 time: 0.045383 Aug 30 01:07:42.119493 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 365/719] 10.222.0.78 () {58 vars in 1413 bytes} [Tue Aug 30 01:07:42 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-volume_attachments/27c68783-6059-4719-8476-d5457fa12248 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:42.737002 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e7a9f2b1-3b65-490f-a9cb-9b840dc91ca2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:42.739146 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e7a9f2b1-3b65-490f-a9cb-9b840dc91ca2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:42.745010 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e7a9f2b1-3b65-490f-a9cb-9b840dc91ca2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:42.745523 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e7a9f2b1-3b65-490f-a9cb-9b840dc91ca2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:42.745953 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e7a9f2b1-3b65-490f-a9cb-9b840dc91ca2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:42.746636 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e7a9f2b1-3b65-490f-a9cb-9b840dc91ca2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:42.747078 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e7a9f2b1-3b65-490f-a9cb-9b840dc91ca2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:42.747495 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e7a9f2b1-3b65-490f-a9cb-9b840dc91ca2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:42.775901 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e7a9f2b1-3b65-490f-a9cb-9b840dc91ca2 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043742 Aug 30 01:07:42.776379 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 355/720] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:07:42 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:07:42.840933 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-d32b3d00-bb8b-439f-a6e0-ae3ca9008dad tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:42.841463 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-d32b3d00-bb8b-439f-a6e0-ae3ca9008dad tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:42.847726 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d32b3d00-bb8b-439f-a6e0-ae3ca9008dad tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:42.848204 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d32b3d00-bb8b-439f-a6e0-ae3ca9008dad tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:42.848631 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d32b3d00-bb8b-439f-a6e0-ae3ca9008dad tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:42.849333 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d32b3d00-bb8b-439f-a6e0-ae3ca9008dad tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:42.849783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d32b3d00-bb8b-439f-a6e0-ae3ca9008dad tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:42.850212 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d32b3d00-bb8b-439f-a6e0-ae3ca9008dad tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:42.874810 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-d32b3d00-bb8b-439f-a6e0-ae3ca9008dad tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Going to try to terminate instance {{(pid=120630) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:07:42.947570 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-d32b3d00-bb8b-439f-a6e0-ae3ca9008dad tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2" status: 204 len: 0 microversion: 2.1 time: 0.110181 Aug 30 01:07:42.948172 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 366/721] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:07:42 2022] DELETE /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:07:42.957186 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-c58d26e0-9bbb-4655-a17c-3da7fe5d86ef tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:42.957809 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-c58d26e0-9bbb-4655-a17c-3da7fe5d86ef tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:42.963964 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c58d26e0-9bbb-4655-a17c-3da7fe5d86ef tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:42.964454 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c58d26e0-9bbb-4655-a17c-3da7fe5d86ef tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:42.964892 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c58d26e0-9bbb-4655-a17c-3da7fe5d86ef tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:42.965625 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c58d26e0-9bbb-4655-a17c-3da7fe5d86ef tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:42.966081 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c58d26e0-9bbb-4655-a17c-3da7fe5d86ef tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:42.966503 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c58d26e0-9bbb-4655-a17c-3da7fe5d86ef tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:43.097332 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-c58d26e0-9bbb-4655-a17c-3da7fe5d86ef tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:43.104919 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-c58d26e0-9bbb-4655-a17c-3da7fe5d86ef tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2" status: 200 len: 1681 microversion: 2.1 time: 0.151762 Aug 30 01:07:43.105522 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 356/722] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:42 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:07:43.457652 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-dc789b27-bc13-451a-b9ee-a568e470d6ad tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae11cd37-3b66-4677-9158-71725f67dabe"}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:07:43.459999 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-dc789b27-bc13-451a-b9ee-a568e470d6ad tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:43.466190 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dc789b27-bc13-451a-b9ee-a568e470d6ad tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:43.466671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dc789b27-bc13-451a-b9ee-a568e470d6ad tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:43.467818 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dc789b27-bc13-451a-b9ee-a568e470d6ad tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:43.468523 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dc789b27-bc13-451a-b9ee-a568e470d6ad tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:43.468970 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dc789b27-bc13-451a-b9ee-a568e470d6ad tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:43.469418 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dc789b27-bc13-451a-b9ee-a568e470d6ad tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:44.127011 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3debe0bd-359a-4489-a4f2-677825386b73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:44.127620 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-3debe0bd-359a-4489-a4f2-677825386b73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:44.133955 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3debe0bd-359a-4489-a4f2-677825386b73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:44.134426 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3debe0bd-359a-4489-a4f2-677825386b73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:44.134852 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3debe0bd-359a-4489-a4f2-677825386b73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:44.135533 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3debe0bd-359a-4489-a4f2-677825386b73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:44.135974 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3debe0bd-359a-4489-a4f2-677825386b73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:44.136390 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3debe0bd-359a-4489-a4f2-677825386b73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:44.276351 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3debe0bd-359a-4489-a4f2-677825386b73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:44.284296 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3debe0bd-359a-4489-a4f2-677825386b73 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2" status: 200 len: 1681 microversion: 2.1 time: 0.161796 Aug 30 01:07:44.284857 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 357/723] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:44 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:07:44.589745 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-dc789b27-bc13-451a-b9ee-a568e470d6ad tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "POST /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.136199 Aug 30 01:07:44.590382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 367/724] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 30 01:07:43 2022] POST /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-volume_attachments => generated 194 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:45.305972 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-25995386-e707-4c0d-83df-5488fa66881a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:45.306599 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-25995386-e707-4c0d-83df-5488fa66881a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:45.314234 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-25995386-e707-4c0d-83df-5488fa66881a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:45.314740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-25995386-e707-4c0d-83df-5488fa66881a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:45.315164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-25995386-e707-4c0d-83df-5488fa66881a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:45.315881 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-25995386-e707-4c0d-83df-5488fa66881a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:45.316335 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-25995386-e707-4c0d-83df-5488fa66881a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:45.316763 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-25995386-e707-4c0d-83df-5488fa66881a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:45.382056 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-25995386-e707-4c0d-83df-5488fa66881a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:45.390905 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-25995386-e707-4c0d-83df-5488fa66881a tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2" status: 200 len: 1613 microversion: 2.1 time: 0.088906 Aug 30 01:07:45.391491 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 358/725] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:45 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 => generated 1613 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:07:45.799746 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-ecdb2091-8226-4739-8091-283430cc4387 req-5aea7447-face-47cf-b79f-0bf5af9265ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d738b454-d1e4-4298-93f4-d0db045454f2", "name": "network-vif-deleted", "tag": "13333188-9b10-4db5-9b32-d0a0505dcd3b"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:07:45.810271 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-ecdb2091-8226-4739-8091-283430cc4387 req-5aea7447-face-47cf-b79f-0bf5af9265ee service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:45.811356 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-ecdb2091-8226-4739-8091-283430cc4387 req-5aea7447-face-47cf-b79f-0bf5af9265ee service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:45.811782 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-ecdb2091-8226-4739-8091-283430cc4387 req-5aea7447-face-47cf-b79f-0bf5af9265ee service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:45.823118 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-ecdb2091-8226-4739-8091-283430cc4387 req-5aea7447-face-47cf-b79f-0bf5af9265ee service nova] Creating event network-vif-deleted:13333188-9b10-4db5-9b32-d0a0505dcd3b for instance d738b454-d1e4-4298-93f4-d0db045454f2 on hv-cinder-81514 Aug 30 01:07:45.829324 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-ecdb2091-8226-4739-8091-283430cc4387 req-5aea7447-face-47cf-b79f-0bf5af9265ee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034665 Aug 30 01:07:45.829928 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 368/726] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:46.413813 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-ac575fec-dcd4-4acd-ba6d-a9b54ddac5bb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:46.415299 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-ac575fec-dcd4-4acd-ba6d-a9b54ddac5bb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:46.422034 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ac575fec-dcd4-4acd-ba6d-a9b54ddac5bb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:46.422518 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ac575fec-dcd4-4acd-ba6d-a9b54ddac5bb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:46.422949 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ac575fec-dcd4-4acd-ba6d-a9b54ddac5bb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:46.423650 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ac575fec-dcd4-4acd-ba6d-a9b54ddac5bb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:46.424096 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ac575fec-dcd4-4acd-ba6d-a9b54ddac5bb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:46.424514 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ac575fec-dcd4-4acd-ba6d-a9b54ddac5bb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:46.467694 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ac575fec-dcd4-4acd-ba6d-a9b54ddac5bb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:46.468175 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ac575fec-dcd4-4acd-ba6d-a9b54ddac5bb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:46.468600 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ac575fec-dcd4-4acd-ba6d-a9b54ddac5bb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:46.469920 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.objects.instance [None req-ac575fec-dcd4-4acd-ba6d-a9b54ddac5bb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lazy-loading 'fault' on Instance uuid d738b454-d1e4-4298-93f4-d0db045454f2 {{(pid=120631) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:07:46.514729 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-ac575fec-dcd4-4acd-ba6d-a9b54ddac5bb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7cf306aadb45d1b65252b53c86b612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0596692dbfb149139a1e72159c6f93db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:46.521804 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-ac575fec-dcd4-4acd-ba6d-a9b54ddac5bb tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2" status: 200 len: 1331 microversion: 2.1 time: 0.112115 Aug 30 01:07:46.522365 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 359/727] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:46 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:07:47.544307 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-355c2f9a-ed67-4f8c-927e-b9cdb63883ea tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:47.544943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-355c2f9a-ed67-4f8c-927e-b9cdb63883ea tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:47.551277 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-355c2f9a-ed67-4f8c-927e-b9cdb63883ea tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:47.551833 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-355c2f9a-ed67-4f8c-927e-b9cdb63883ea tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:47.552267 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-355c2f9a-ed67-4f8c-927e-b9cdb63883ea tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:47.552955 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-355c2f9a-ed67-4f8c-927e-b9cdb63883ea tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:47.553429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-355c2f9a-ed67-4f8c-927e-b9cdb63883ea tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:47.553849 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-355c2f9a-ed67-4f8c-927e-b9cdb63883ea tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:47.567604 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-355c2f9a-ed67-4f8c-927e-b9cdb63883ea tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] HTTP exception thrown: Instance d738b454-d1e4-4298-93f4-d0db045454f2 could not be found. Aug 30 01:07:47.569294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-355c2f9a-ed67-4f8c-927e-b9cdb63883ea tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Request method failure captured: Aug 30 01:07:47.569294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 HTTP/1.1 Aug 30 01:07:47.569294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:07:47.569294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:07:47.569294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:07:47.569294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:07:47.569294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:07:47.569294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:07:47.569294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:07:47.569294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:07:47.569294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWFfZmUwgQ0mFuieojBsvktSnruxexkMD8R8bd6MnZKGHmPnXPTUGPvemFUgtcXUu8u-yzCNpJULMfiAasm8f-KjX-nH3CChWEIyCAavljtkV9ICnALTHbbll4hz4f_VNsMQOGGKv1XAa5uQHI8I8bGS718FQfoeBt-22Hj_CVvvdxo Aug 30 01:07:47.569294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:07:47.569294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:07:47.569294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:07:47.569294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:07:47.569294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:07:47.569294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:07:47.569294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:07:47.569294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:47.569294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:07:47.569294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:07:47.570930 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0596692dbfb149139a1e72159c6f93db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}] Aug 30 01:07:47.570930 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:47.570930 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:07:47.570930 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:47.570930 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:07:47.570930 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:07:47.570930 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:07:47.570930 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: cc7cf306aadb45d1b65252b53c86b612 Aug 30 01:07:47.570930 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:07:47.570930 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:07:47.570930 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Instance d738b454-d1e4-4298-93f4-d0db045454f2 could not be found. Aug 30 01:07:47.570930 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': 'd738b454-d1e4-4298-93f4-d0db045454f2'} Aug 30 01:07:47.571828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:07:47.571828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:47.571828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:07:47.571828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:07:47.571828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:07:47.571828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:07:47.571828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:07:47.571828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:07:47.571828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:07:47.571828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:07:47.571828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d738b454-d1e4-4298-93f4-d0db045454f2 could not be found. Aug 30 01:07:47.571828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:47.571828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:07:47.571828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:47.571828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:47.571828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:07:47.571828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:07:47.571828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:07:47.571828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:07:47.571828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:07:47.573384 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:07:47.573384 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:07:47.573384 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:07:47.573384 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:07:47.573384 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:07:47.573384 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:07:47.573384 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:07:47.573384 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d738b454-d1e4-4298-93f4-d0db045454f2 could not be found. Aug 30 01:07:47.573384 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:47.573384 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:07:47.573384 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:47.573384 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:47.573384 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:07:47.573384 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:07:47.573384 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:07:47.573384 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:07:47.573384 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d738b454-d1e4-4298-93f4-d0db045454f2 could not be found. Aug 30 01:07:47.573384 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:47.574794 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-355c2f9a-ed67-4f8c-927e-b9cdb63883ea tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Returning 404 to user: Instance d738b454-d1e4-4298-93f4-d0db045454f2 could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:07:47.574794 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-355c2f9a-ed67-4f8c-927e-b9cdb63883ea tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2" status: 404 len: 111 microversion: 2.1 time: 0.031343 Aug 30 01:07:47.574794 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 369/728] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:47 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:07:47.581146 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-471cefd8-636c-48b9-b801-e5d2db5575c6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '.version_select at 0x7f0f5266f160>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:47.600346 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-471cefd8-636c-48b9-b801-e5d2db5575c6 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1122632298" status: 202 len: 0 microversion: 2.1 time: 0.024544 Aug 30 01:07:47.600899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 360/729] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Aug 30 01:07:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1122632298 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:07:49.339089 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-087ec18a-25ff-41ae-9a64-387a23b2bd56 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:49.339582 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-087ec18a-25ff-41ae-9a64-387a23b2bd56 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:49.345990 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-087ec18a-25ff-41ae-9a64-387a23b2bd56 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:49.346468 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-087ec18a-25ff-41ae-9a64-387a23b2bd56 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:49.346898 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-087ec18a-25ff-41ae-9a64-387a23b2bd56 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:49.347574 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-087ec18a-25ff-41ae-9a64-387a23b2bd56 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:49.348021 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-087ec18a-25ff-41ae-9a64-387a23b2bd56 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:49.348441 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-087ec18a-25ff-41ae-9a64-387a23b2bd56 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:49.361445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-087ec18a-25ff-41ae-9a64-387a23b2bd56 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] HTTP exception thrown: Instance d738b454-d1e4-4298-93f4-d0db045454f2 could not be found. Aug 30 01:07:49.362963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-087ec18a-25ff-41ae-9a64-387a23b2bd56 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Request method failure captured: Aug 30 01:07:49.362963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: DELETE /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 HTTP/1.1 Aug 30 01:07:49.362963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:07:49.362963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:07:49.362963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:07:49.362963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:07:49.362963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:07:49.362963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:07:49.362963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:07:49.362963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:07:49.362963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWFfZmUwgQ0mFuieojBsvktSnruxexkMD8R8bd6MnZKGHmPnXPTUGPvemFUgtcXUu8u-yzCNpJULMfiAasm8f-KjX-nH3CChWEIyCAavljtkV9ICnALTHbbll4hz4f_VNsMQOGGKv1XAa5uQHI8I8bGS718FQfoeBt-22Hj_CVvvdxo Aug 30 01:07:49.362963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:07:49.362963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:07:49.362963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:07:49.362963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:07:49.362963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:07:49.362963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:07:49.362963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:07:49.362963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:49.362963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:07:49.362963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:07:49.364445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0596692dbfb149139a1e72159c6f93db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}] Aug 30 01:07:49.364445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:49.364445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:07:49.364445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:49.364445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:07:49.364445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:07:49.364445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:07:49.364445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: cc7cf306aadb45d1b65252b53c86b612 Aug 30 01:07:49.364445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:07:49.364445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:07:49.364445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Instance d738b454-d1e4-4298-93f4-d0db045454f2 could not be found. Aug 30 01:07:49.364445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': 'd738b454-d1e4-4298-93f4-d0db045454f2'} Aug 30 01:07:49.365308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:07:49.365308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:49.365308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:07:49.365308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:07:49.365308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:07:49.365308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:07:49.365308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:07:49.365308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:07:49.365308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:07:49.365308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:07:49.365308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d738b454-d1e4-4298-93f4-d0db045454f2 could not be found. Aug 30 01:07:49.365308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:49.365308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:07:49.365308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:49.365308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:49.365308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:07:49.365308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:07:49.365308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:07:49.365308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:07:49.365308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:07:49.366688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:07:49.366688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:07:49.366688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:07:49.366688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:07:49.366688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:07:49.366688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:07:49.366688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:07:49.366688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:07:49.366688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:07:49.366688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d738b454-d1e4-4298-93f4-d0db045454f2 could not be found. Aug 30 01:07:49.366688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:49.366688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:07:49.366688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:49.366688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:49.366688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:07:49.366688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:07:49.366688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:07:49.366688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:07:49.366688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d738b454-d1e4-4298-93f4-d0db045454f2 could not be found. Aug 30 01:07:49.366688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:49.368304 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-087ec18a-25ff-41ae-9a64-387a23b2bd56 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Returning 404 to user: Instance d738b454-d1e4-4298-93f4-d0db045454f2 could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:07:49.368304 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-087ec18a-25ff-41ae-9a64-387a23b2bd56 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2" status: 404 len: 111 microversion: 2.1 time: 0.029179 Aug 30 01:07:49.368304 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 370/730] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:07:49 2022] DELETE /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:07:49.374513 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3806df3c-6f57-43d8-8fc8-af858f17f8c4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:49.375128 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-3806df3c-6f57-43d8-8fc8-af858f17f8c4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: d738b454-d1e4-4298-93f4-d0db045454f2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:49.382564 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3806df3c-6f57-43d8-8fc8-af858f17f8c4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:49.383175 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3806df3c-6f57-43d8-8fc8-af858f17f8c4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:49.383629 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3806df3c-6f57-43d8-8fc8-af858f17f8c4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:49.384315 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3806df3c-6f57-43d8-8fc8-af858f17f8c4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:49.384762 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3806df3c-6f57-43d8-8fc8-af858f17f8c4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:49.385217 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3806df3c-6f57-43d8-8fc8-af858f17f8c4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:49.398861 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-3806df3c-6f57-43d8-8fc8-af858f17f8c4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] HTTP exception thrown: Instance d738b454-d1e4-4298-93f4-d0db045454f2 could not be found. Aug 30 01:07:49.400489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3806df3c-6f57-43d8-8fc8-af858f17f8c4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Request method failure captured: Aug 30 01:07:49.400489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 HTTP/1.1 Aug 30 01:07:49.400489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:07:49.400489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:07:49.400489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:07:49.400489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:07:49.400489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:07:49.400489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:07:49.400489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:07:49.400489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:07:49.400489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWFfZmUwgQ0mFuieojBsvktSnruxexkMD8R8bd6MnZKGHmPnXPTUGPvemFUgtcXUu8u-yzCNpJULMfiAasm8f-KjX-nH3CChWEIyCAavljtkV9ICnALTHbbll4hz4f_VNsMQOGGKv1XAa5uQHI8I8bGS718FQfoeBt-22Hj_CVvvdxo Aug 30 01:07:49.400489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:07:49.400489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:07:49.400489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:07:49.400489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:07:49.400489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:07:49.400489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:07:49.400489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:07:49.400489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:49.400489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:07:49.400489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:07:49.402108 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0596692dbfb149139a1e72159c6f93db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}] Aug 30 01:07:49.402108 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:49.402108 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:07:49.402108 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:49.402108 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:07:49.402108 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:07:49.402108 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:07:49.402108 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: cc7cf306aadb45d1b65252b53c86b612 Aug 30 01:07:49.402108 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:07:49.402108 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:07:49.402108 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Instance d738b454-d1e4-4298-93f4-d0db045454f2 could not be found. Aug 30 01:07:49.402108 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': 'd738b454-d1e4-4298-93f4-d0db045454f2'} Aug 30 01:07:49.403020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:07:49.403020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:49.403020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:07:49.403020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:07:49.403020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:07:49.403020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:07:49.403020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:07:49.403020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:07:49.403020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:07:49.403020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:07:49.403020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d738b454-d1e4-4298-93f4-d0db045454f2 could not be found. Aug 30 01:07:49.403020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:07:49.403020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:07:49.403020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:07:49.403020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:49.403020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:07:49.403020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:07:49.403020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:07:49.403020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:07:49.403020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:07:49.404906 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:07:49.404906 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:07:49.404906 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:07:49.404906 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:07:49.404906 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:07:49.404906 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:07:49.404906 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:07:49.404906 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d738b454-d1e4-4298-93f4-d0db045454f2 could not be found. Aug 30 01:07:49.404906 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:07:49.404906 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:07:49.404906 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:07:49.404906 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:49.404906 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:07:49.404906 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:07:49.404906 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:07:49.404906 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:07:49.404906 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d738b454-d1e4-4298-93f4-d0db045454f2 could not be found. Aug 30 01:07:49.404906 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:07:49.406549 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3806df3c-6f57-43d8-8fc8-af858f17f8c4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Returning 404 to user: Instance d738b454-d1e4-4298-93f4-d0db045454f2 could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:07:49.406549 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3806df3c-6f57-43d8-8fc8-af858f17f8c4 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2" status: 404 len: 111 microversion: 2.1 time: 0.033124 Aug 30 01:07:49.406549 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 361/731] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:49 2022] GET /compute/v2.1/servers/d738b454-d1e4-4298-93f4-d0db045454f2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:07:50.541153 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f1b2f047-6a34-429d-8cc1-a49b78922a13 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:50.541689 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-f1b2f047-6a34-429d-8cc1-a49b78922a13 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:50.549447 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f1b2f047-6a34-429d-8cc1-a49b78922a13 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:50.549944 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f1b2f047-6a34-429d-8cc1-a49b78922a13 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:50.550381 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f1b2f047-6a34-429d-8cc1-a49b78922a13 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:50.551083 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f1b2f047-6a34-429d-8cc1-a49b78922a13 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:50.551539 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f1b2f047-6a34-429d-8cc1-a49b78922a13 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:50.551968 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f1b2f047-6a34-429d-8cc1-a49b78922a13 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:50.567489 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-f1b2f047-6a34-429d-8cc1-a49b78922a13 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] HTTP exception thrown: Instance 4af1febc-f5f3-440d-ab4b-0e33ac174325 could not be found. Aug 30 01:07:50.569086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f1b2f047-6a34-429d-8cc1-a49b78922a13 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Request method failure captured: Aug 30 01:07:50.569086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: DELETE /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325 HTTP/1.1 Aug 30 01:07:50.569086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:07:50.569086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:07:50.569086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:07:50.569086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:07:50.569086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:07:50.569086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:07:50.569086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:07:50.569086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:07:50.569086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWFfZmUwgQ0mFuieojBsvktSnruxexkMD8R8bd6MnZKGHmPnXPTUGPvemFUgtcXUu8u-yzCNpJULMfiAasm8f-KjX-nH3CChWEIyCAavljtkV9ICnALTHbbll4hz4f_VNsMQOGGKv1XAa5uQHI8I8bGS718FQfoeBt-22Hj_CVvvdxo Aug 30 01:07:50.569086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:07:50.569086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:07:50.569086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:07:50.569086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:07:50.569086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:07:50.569086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:07:50.569086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:07:50.569086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:50.569086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:07:50.569086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:07:50.570631 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0596692dbfb149139a1e72159c6f93db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}] Aug 30 01:07:50.570631 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:50.570631 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:07:50.570631 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:50.570631 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:07:50.570631 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:07:50.570631 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:07:50.570631 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: cc7cf306aadb45d1b65252b53c86b612 Aug 30 01:07:50.570631 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:07:50.570631 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:07:50.570631 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Instance 4af1febc-f5f3-440d-ab4b-0e33ac174325 could not be found. Aug 30 01:07:50.570631 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': '4af1febc-f5f3-440d-ab4b-0e33ac174325'} Aug 30 01:07:50.571516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:07:50.571516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:50.571516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:07:50.571516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:07:50.571516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:07:50.571516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:07:50.571516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:07:50.571516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:07:50.571516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:07:50.571516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:07:50.571516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4af1febc-f5f3-440d-ab4b-0e33ac174325 could not be found. Aug 30 01:07:50.571516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:50.571516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:07:50.571516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:50.571516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:50.571516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:07:50.571516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:07:50.571516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:07:50.571516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:07:50.571516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:07:50.572776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:07:50.572776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:07:50.572776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:07:50.572776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:07:50.572776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:07:50.572776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:07:50.572776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:07:50.572776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:07:50.572776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:07:50.572776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4af1febc-f5f3-440d-ab4b-0e33ac174325 could not be found. Aug 30 01:07:50.572776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:50.572776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:07:50.572776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:50.572776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:50.572776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:07:50.572776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:07:50.572776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:07:50.572776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:07:50.572776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4af1febc-f5f3-440d-ab4b-0e33ac174325 could not be found. Aug 30 01:07:50.572776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:50.574136 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f1b2f047-6a34-429d-8cc1-a49b78922a13 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Returning 404 to user: Instance 4af1febc-f5f3-440d-ab4b-0e33ac174325 could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:07:50.574136 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-f1b2f047-6a34-429d-8cc1-a49b78922a13 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325" status: 404 len: 111 microversion: 2.1 time: 0.033302 Aug 30 01:07:50.574136 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 371/732] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:07:50 2022] DELETE /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:07:50.580419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-14a6cf40-5af1-466f-88ee-1f93616a1c6b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:50.581033 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-14a6cf40-5af1-466f-88ee-1f93616a1c6b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 4af1febc-f5f3-440d-ab4b-0e33ac174325] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:50.587482 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-14a6cf40-5af1-466f-88ee-1f93616a1c6b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:50.587962 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-14a6cf40-5af1-466f-88ee-1f93616a1c6b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:50.588395 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-14a6cf40-5af1-466f-88ee-1f93616a1c6b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:50.589108 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-14a6cf40-5af1-466f-88ee-1f93616a1c6b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:50.589570 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-14a6cf40-5af1-466f-88ee-1f93616a1c6b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:50.590011 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-14a6cf40-5af1-466f-88ee-1f93616a1c6b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:50.604334 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-14a6cf40-5af1-466f-88ee-1f93616a1c6b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] HTTP exception thrown: Instance 4af1febc-f5f3-440d-ab4b-0e33ac174325 could not be found. Aug 30 01:07:50.606000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-14a6cf40-5af1-466f-88ee-1f93616a1c6b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Request method failure captured: Aug 30 01:07:50.606000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325 HTTP/1.1 Aug 30 01:07:50.606000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:07:50.606000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:07:50.606000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:07:50.606000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:07:50.606000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:07:50.606000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:07:50.606000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:07:50.606000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:07:50.606000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWFfZmUwgQ0mFuieojBsvktSnruxexkMD8R8bd6MnZKGHmPnXPTUGPvemFUgtcXUu8u-yzCNpJULMfiAasm8f-KjX-nH3CChWEIyCAavljtkV9ICnALTHbbll4hz4f_VNsMQOGGKv1XAa5uQHI8I8bGS718FQfoeBt-22Hj_CVvvdxo Aug 30 01:07:50.606000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:07:50.606000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:07:50.606000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:07:50.606000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:07:50.606000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:07:50.606000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:07:50.606000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:07:50.606000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:50.606000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:07:50.606000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:07:50.607656 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0596692dbfb149139a1e72159c6f93db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}] Aug 30 01:07:50.607656 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:50.607656 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:07:50.607656 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:50.607656 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:07:50.607656 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:07:50.607656 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:07:50.607656 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: cc7cf306aadb45d1b65252b53c86b612 Aug 30 01:07:50.607656 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:07:50.607656 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:07:50.607656 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Instance 4af1febc-f5f3-440d-ab4b-0e33ac174325 could not be found. Aug 30 01:07:50.607656 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': '4af1febc-f5f3-440d-ab4b-0e33ac174325'} Aug 30 01:07:50.608598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:07:50.608598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:50.608598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:07:50.608598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:07:50.608598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:07:50.608598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:07:50.608598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:07:50.608598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:07:50.608598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:07:50.608598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:07:50.608598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4af1febc-f5f3-440d-ab4b-0e33ac174325 could not be found. Aug 30 01:07:50.608598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:07:50.608598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:07:50.608598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:07:50.608598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:50.608598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:07:50.608598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:07:50.608598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:07:50.608598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:07:50.608598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:07:50.610022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:07:50.610022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:07:50.610022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:07:50.610022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:07:50.610022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:07:50.610022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:07:50.610022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:07:50.610022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4af1febc-f5f3-440d-ab4b-0e33ac174325 could not be found. Aug 30 01:07:50.610022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:07:50.610022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:07:50.610022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:07:50.610022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:50.610022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:07:50.610022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:07:50.610022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:07:50.610022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:07:50.610022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4af1febc-f5f3-440d-ab4b-0e33ac174325 could not be found. Aug 30 01:07:50.610022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:07:50.611270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-14a6cf40-5af1-466f-88ee-1f93616a1c6b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Returning 404 to user: Instance 4af1febc-f5f3-440d-ab4b-0e33ac174325 could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:07:50.611270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-14a6cf40-5af1-466f-88ee-1f93616a1c6b tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325" status: 404 len: 111 microversion: 2.1 time: 0.032013 Aug 30 01:07:50.611270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 362/733] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:50 2022] GET /compute/v2.1/servers/4af1febc-f5f3-440d-ab4b-0e33ac174325 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:07:50.617771 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4feb1865-25e0-4026-9c56-0f9ad5c5402f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:50.618266 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-4feb1865-25e0-4026-9c56-0f9ad5c5402f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:50.624519 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4feb1865-25e0-4026-9c56-0f9ad5c5402f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:50.624996 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4feb1865-25e0-4026-9c56-0f9ad5c5402f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:50.625504 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4feb1865-25e0-4026-9c56-0f9ad5c5402f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:50.626181 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4feb1865-25e0-4026-9c56-0f9ad5c5402f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:50.626626 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4feb1865-25e0-4026-9c56-0f9ad5c5402f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:50.627050 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4feb1865-25e0-4026-9c56-0f9ad5c5402f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:50.640584 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-4feb1865-25e0-4026-9c56-0f9ad5c5402f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] HTTP exception thrown: Instance 0f9ce423-87fe-4742-ab18-537e725fb3c2 could not be found. Aug 30 01:07:50.642128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4feb1865-25e0-4026-9c56-0f9ad5c5402f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Request method failure captured: Aug 30 01:07:50.642128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: DELETE /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 HTTP/1.1 Aug 30 01:07:50.642128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:07:50.642128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:07:50.642128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:07:50.642128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:07:50.642128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:07:50.642128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:07:50.642128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:07:50.642128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:07:50.642128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWFfZmUwgQ0mFuieojBsvktSnruxexkMD8R8bd6MnZKGHmPnXPTUGPvemFUgtcXUu8u-yzCNpJULMfiAasm8f-KjX-nH3CChWEIyCAavljtkV9ICnALTHbbll4hz4f_VNsMQOGGKv1XAa5uQHI8I8bGS718FQfoeBt-22Hj_CVvvdxo Aug 30 01:07:50.642128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:07:50.642128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:07:50.642128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:07:50.642128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:07:50.642128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:07:50.642128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:07:50.642128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:07:50.642128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:50.642128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:07:50.642128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:07:50.643643 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0596692dbfb149139a1e72159c6f93db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}] Aug 30 01:07:50.643643 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:50.643643 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:07:50.643643 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:50.643643 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:07:50.643643 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:07:50.643643 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:07:50.643643 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: cc7cf306aadb45d1b65252b53c86b612 Aug 30 01:07:50.643643 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:07:50.643643 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:07:50.643643 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Instance 0f9ce423-87fe-4742-ab18-537e725fb3c2 could not be found. Aug 30 01:07:50.643643 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': '0f9ce423-87fe-4742-ab18-537e725fb3c2'} Aug 30 01:07:50.644425 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:07:50.644425 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:50.644425 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:07:50.644425 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:07:50.644425 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:07:50.644425 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:07:50.644425 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:07:50.644425 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:07:50.644425 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:07:50.644425 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:07:50.644425 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f9ce423-87fe-4742-ab18-537e725fb3c2 could not be found. Aug 30 01:07:50.644425 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:50.644425 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:07:50.644425 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:50.644425 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:50.644425 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:07:50.644425 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:07:50.644425 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:07:50.644425 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:07:50.644425 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:07:50.645648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:07:50.645648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:07:50.645648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:07:50.645648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:07:50.645648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:07:50.645648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:07:50.645648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:07:50.645648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:07:50.645648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:07:50.645648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f9ce423-87fe-4742-ab18-537e725fb3c2 could not be found. Aug 30 01:07:50.645648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:50.645648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:07:50.645648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:50.645648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:50.645648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:07:50.645648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:07:50.645648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:07:50.645648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:07:50.645648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f9ce423-87fe-4742-ab18-537e725fb3c2 could not be found. Aug 30 01:07:50.645648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:50.646872 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4feb1865-25e0-4026-9c56-0f9ad5c5402f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Returning 404 to user: Instance 0f9ce423-87fe-4742-ab18-537e725fb3c2 could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:07:50.646872 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-4feb1865-25e0-4026-9c56-0f9ad5c5402f tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 404 len: 111 microversion: 2.1 time: 0.029894 Aug 30 01:07:50.646872 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 372/734] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:07:50 2022] DELETE /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:07:50.652047 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-b2d152a3-e7ca-4c87-be8e-28a5768c7d45 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:50.652669 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-b2d152a3-e7ca-4c87-be8e-28a5768c7d45 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 0f9ce423-87fe-4742-ab18-537e725fb3c2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:50.659890 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b2d152a3-e7ca-4c87-be8e-28a5768c7d45 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:50.660372 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b2d152a3-e7ca-4c87-be8e-28a5768c7d45 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:50.660809 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b2d152a3-e7ca-4c87-be8e-28a5768c7d45 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:50.661535 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b2d152a3-e7ca-4c87-be8e-28a5768c7d45 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:50.661989 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b2d152a3-e7ca-4c87-be8e-28a5768c7d45 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:50.662411 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-b2d152a3-e7ca-4c87-be8e-28a5768c7d45 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:50.676060 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-b2d152a3-e7ca-4c87-be8e-28a5768c7d45 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] HTTP exception thrown: Instance 0f9ce423-87fe-4742-ab18-537e725fb3c2 could not be found. Aug 30 01:07:50.677614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-b2d152a3-e7ca-4c87-be8e-28a5768c7d45 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Request method failure captured: Aug 30 01:07:50.677614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 HTTP/1.1 Aug 30 01:07:50.677614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:07:50.677614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:07:50.677614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:07:50.677614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:07:50.677614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:07:50.677614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:07:50.677614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:07:50.677614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:07:50.677614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWFfZmUwgQ0mFuieojBsvktSnruxexkMD8R8bd6MnZKGHmPnXPTUGPvemFUgtcXUu8u-yzCNpJULMfiAasm8f-KjX-nH3CChWEIyCAavljtkV9ICnALTHbbll4hz4f_VNsMQOGGKv1XAa5uQHI8I8bGS718FQfoeBt-22Hj_CVvvdxo Aug 30 01:07:50.677614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:07:50.677614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:07:50.677614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:07:50.677614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:07:50.677614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:07:50.677614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:07:50.677614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:07:50.677614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:50.677614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:07:50.677614 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:07:50.679187 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0596692dbfb149139a1e72159c6f93db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}] Aug 30 01:07:50.679187 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:50.679187 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:07:50.679187 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:50.679187 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:07:50.679187 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:07:50.679187 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:07:50.679187 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: cc7cf306aadb45d1b65252b53c86b612 Aug 30 01:07:50.679187 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:07:50.679187 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:07:50.679187 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Instance 0f9ce423-87fe-4742-ab18-537e725fb3c2 could not be found. Aug 30 01:07:50.679187 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': '0f9ce423-87fe-4742-ab18-537e725fb3c2'} Aug 30 01:07:50.680103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:07:50.680103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:50.680103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:07:50.680103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:07:50.680103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:07:50.680103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:07:50.680103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:07:50.680103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:07:50.680103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:07:50.680103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:07:50.680103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f9ce423-87fe-4742-ab18-537e725fb3c2 could not be found. Aug 30 01:07:50.680103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:07:50.680103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:07:50.680103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:07:50.680103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:50.680103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:07:50.680103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:07:50.680103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:07:50.680103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:07:50.680103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:07:50.681474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:07:50.681474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:07:50.681474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:07:50.681474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:07:50.681474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:07:50.681474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:07:50.681474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:07:50.681474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f9ce423-87fe-4742-ab18-537e725fb3c2 could not be found. Aug 30 01:07:50.681474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:07:50.681474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:07:50.681474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:07:50.681474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:50.681474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:07:50.681474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:07:50.681474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:07:50.681474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:07:50.681474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f9ce423-87fe-4742-ab18-537e725fb3c2 could not be found. Aug 30 01:07:50.681474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:07:50.682621 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-b2d152a3-e7ca-4c87-be8e-28a5768c7d45 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Returning 404 to user: Instance 0f9ce423-87fe-4742-ab18-537e725fb3c2 could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:07:50.682621 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-b2d152a3-e7ca-4c87-be8e-28a5768c7d45 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2" status: 404 len: 111 microversion: 2.1 time: 0.030797 Aug 30 01:07:50.682621 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 363/735] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:50 2022] GET /compute/v2.1/servers/0f9ce423-87fe-4742-ab18-537e725fb3c2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:07:51.823455 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-bec1eb8a-4e29-49a7-b803-207ff1d482ff tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:51.823948 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-bec1eb8a-4e29-49a7-b803-207ff1d482ff tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:51.830928 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bec1eb8a-4e29-49a7-b803-207ff1d482ff tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:51.831400 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bec1eb8a-4e29-49a7-b803-207ff1d482ff tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:51.831829 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bec1eb8a-4e29-49a7-b803-207ff1d482ff tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:51.832501 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bec1eb8a-4e29-49a7-b803-207ff1d482ff tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:51.832948 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bec1eb8a-4e29-49a7-b803-207ff1d482ff tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:51.833407 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bec1eb8a-4e29-49a7-b803-207ff1d482ff tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:51.846399 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-bec1eb8a-4e29-49a7-b803-207ff1d482ff tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] HTTP exception thrown: Instance 8d2ed1b9-2567-4964-83fd-dd44533766ae could not be found. Aug 30 01:07:51.847940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-bec1eb8a-4e29-49a7-b803-207ff1d482ff tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Request method failure captured: Aug 30 01:07:51.847940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: DELETE /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae HTTP/1.1 Aug 30 01:07:51.847940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:07:51.847940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:07:51.847940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:07:51.847940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:07:51.847940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:07:51.847940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:07:51.847940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:07:51.847940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:07:51.847940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWFfZmUwgQ0mFuieojBsvktSnruxexkMD8R8bd6MnZKGHmPnXPTUGPvemFUgtcXUu8u-yzCNpJULMfiAasm8f-KjX-nH3CChWEIyCAavljtkV9ICnALTHbbll4hz4f_VNsMQOGGKv1XAa5uQHI8I8bGS718FQfoeBt-22Hj_CVvvdxo Aug 30 01:07:51.847940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:07:51.847940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:07:51.847940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:07:51.847940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:07:51.847940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:07:51.847940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:07:51.847940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:07:51.847940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:51.847940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:07:51.847940 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:07:51.849582 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0596692dbfb149139a1e72159c6f93db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}] Aug 30 01:07:51.849582 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:51.849582 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:07:51.849582 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:51.849582 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:07:51.849582 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:07:51.849582 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:07:51.849582 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: cc7cf306aadb45d1b65252b53c86b612 Aug 30 01:07:51.849582 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:07:51.849582 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:07:51.849582 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Instance 8d2ed1b9-2567-4964-83fd-dd44533766ae could not be found. Aug 30 01:07:51.849582 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': '8d2ed1b9-2567-4964-83fd-dd44533766ae'} Aug 30 01:07:51.850532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:07:51.850532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:51.850532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:07:51.850532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:07:51.850532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:07:51.850532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:07:51.850532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:07:51.850532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:07:51.850532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:07:51.850532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:07:51.850532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d2ed1b9-2567-4964-83fd-dd44533766ae could not be found. Aug 30 01:07:51.850532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:51.850532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:07:51.850532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:51.850532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:51.850532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:07:51.850532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:07:51.850532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:07:51.850532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:07:51.850532 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:07:51.851947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:07:51.851947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:07:51.851947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:07:51.851947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:07:51.851947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:07:51.851947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:07:51.851947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:07:51.851947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:07:51.851947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:07:51.851947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d2ed1b9-2567-4964-83fd-dd44533766ae could not be found. Aug 30 01:07:51.851947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:51.851947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:07:51.851947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:51.851947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:51.851947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:07:51.851947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:07:51.851947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:07:51.851947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:07:51.851947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d2ed1b9-2567-4964-83fd-dd44533766ae could not be found. Aug 30 01:07:51.851947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:07:51.853414 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-bec1eb8a-4e29-49a7-b803-207ff1d482ff tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Returning 404 to user: Instance 8d2ed1b9-2567-4964-83fd-dd44533766ae could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:07:51.853414 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-bec1eb8a-4e29-49a7-b803-207ff1d482ff tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 404 len: 111 microversion: 2.1 time: 0.029650 Aug 30 01:07:51.853414 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 373/736] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:07:51 2022] DELETE /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:07:51.857860 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-333aabb5-bcb0-4b12-b4dc-8b96a47f5484 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:51.858502 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-333aabb5-bcb0-4b12-b4dc-8b96a47f5484 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] [instance: 8d2ed1b9-2567-4964-83fd-dd44533766ae] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:51.864890 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-333aabb5-bcb0-4b12-b4dc-8b96a47f5484 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:51.865412 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-333aabb5-bcb0-4b12-b4dc-8b96a47f5484 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:51.865851 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-333aabb5-bcb0-4b12-b4dc-8b96a47f5484 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:51.866543 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-333aabb5-bcb0-4b12-b4dc-8b96a47f5484 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:51.867001 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-333aabb5-bcb0-4b12-b4dc-8b96a47f5484 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:51.867425 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-333aabb5-bcb0-4b12-b4dc-8b96a47f5484 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:51.881272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-333aabb5-bcb0-4b12-b4dc-8b96a47f5484 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] HTTP exception thrown: Instance 8d2ed1b9-2567-4964-83fd-dd44533766ae could not be found. Aug 30 01:07:51.882776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-333aabb5-bcb0-4b12-b4dc-8b96a47f5484 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Request method failure captured: Aug 30 01:07:51.882776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae HTTP/1.1 Aug 30 01:07:51.882776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:07:51.882776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:07:51.882776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:07:51.882776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:07:51.882776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:07:51.882776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:07:51.882776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:07:51.882776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:07:51.882776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWFfZmUwgQ0mFuieojBsvktSnruxexkMD8R8bd6MnZKGHmPnXPTUGPvemFUgtcXUu8u-yzCNpJULMfiAasm8f-KjX-nH3CChWEIyCAavljtkV9ICnALTHbbll4hz4f_VNsMQOGGKv1XAa5uQHI8I8bGS718FQfoeBt-22Hj_CVvvdxo Aug 30 01:07:51.882776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:07:51.882776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:07:51.882776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:07:51.882776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:07:51.882776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:07:51.882776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:07:51.882776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:07:51.882776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:51.882776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:07:51.882776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:07:51.884275 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0596692dbfb149139a1e72159c6f93db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0596692dbfb149139a1e72159c6f93db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0596692dbfb149139a1e72159c6f93db"}]}] Aug 30 01:07:51.884275 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:51.884275 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: 0596692dbfb149139a1e72159c6f93db Aug 30 01:07:51.884275 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1485582882 Aug 30 01:07:51.884275 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:07:51.884275 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:07:51.884275 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:07:51.884275 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: cc7cf306aadb45d1b65252b53c86b612 Aug 30 01:07:51.884275 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-AttachVolumeNegativeTest-1485582882-project Aug 30 01:07:51.884275 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:07:51.884275 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Instance 8d2ed1b9-2567-4964-83fd-dd44533766ae could not be found. Aug 30 01:07:51.884275 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': '8d2ed1b9-2567-4964-83fd-dd44533766ae'} Aug 30 01:07:51.885179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:07:51.885179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:51.885179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:07:51.885179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:07:51.885179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:07:51.885179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:07:51.885179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:07:51.885179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:07:51.885179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:07:51.885179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:07:51.885179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d2ed1b9-2567-4964-83fd-dd44533766ae could not be found. Aug 30 01:07:51.885179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:07:51.885179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:07:51.885179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:07:51.885179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:51.885179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:07:51.885179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:07:51.885179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:07:51.885179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:07:51.885179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:07:51.886683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:07:51.886683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:07:51.886683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:07:51.886683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:07:51.886683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:07:51.886683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:07:51.886683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:07:51.886683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d2ed1b9-2567-4964-83fd-dd44533766ae could not be found. Aug 30 01:07:51.886683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:07:51.886683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:07:51.886683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:07:51.886683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:07:51.886683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:07:51.886683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:07:51.886683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:07:51.886683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:07:51.886683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d2ed1b9-2567-4964-83fd-dd44533766ae could not be found. Aug 30 01:07:51.886683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:07:51.887969 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-333aabb5-bcb0-4b12-b4dc-8b96a47f5484 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] Returning 404 to user: Instance 8d2ed1b9-2567-4964-83fd-dd44533766ae could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:07:51.887969 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-333aabb5-bcb0-4b12-b4dc-8b96a47f5484 tempest-AttachVolumeNegativeTest-1485582882 tempest-AttachVolumeNegativeTest-1485582882-project] 10.222.0.78 "GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae" status: 404 len: 111 microversion: 2.1 time: 0.030104 Aug 30 01:07:51.887969 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 364/737] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:51 2022] GET /compute/v2.1/servers/8d2ed1b9-2567-4964-83fd-dd44533766ae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:07:52.128962 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-256f9aef-fc96-45d5-a642-fe5ee5ae30db tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:52.131293 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-256f9aef-fc96-45d5-a642-fe5ee5ae30db tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:52.137162 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-256f9aef-fc96-45d5-a642-fe5ee5ae30db tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:52.137658 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-256f9aef-fc96-45d5-a642-fe5ee5ae30db tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:52.138099 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-256f9aef-fc96-45d5-a642-fe5ee5ae30db tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:52.139440 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-256f9aef-fc96-45d5-a642-fe5ee5ae30db tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:52.139905 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-256f9aef-fc96-45d5-a642-fe5ee5ae30db tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:52.140340 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-256f9aef-fc96-45d5-a642-fe5ee5ae30db tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:52.166657 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:52.172893 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-256f9aef-fc96-45d5-a642-fe5ee5ae30db tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047840 Aug 30 01:07:52.173498 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 374/738] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:07:52 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:52.320775 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-092a4e97-3802-478f-92b9-ecdd3592ccd0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:52.321505 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-092a4e97-3802-478f-92b9-ecdd3592ccd0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:52.327996 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-092a4e97-3802-478f-92b9-ecdd3592ccd0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:52.328487 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-092a4e97-3802-478f-92b9-ecdd3592ccd0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:52.328929 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-092a4e97-3802-478f-92b9-ecdd3592ccd0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:52.329664 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-092a4e97-3802-478f-92b9-ecdd3592ccd0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:52.330116 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-092a4e97-3802-478f-92b9-ecdd3592ccd0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:52.330571 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-092a4e97-3802-478f-92b9-ecdd3592ccd0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:52.363434 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-092a4e97-3802-478f-92b9-ecdd3592ccd0 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-volume_attachments/27c68783-6059-4719-8476-d5457fa12248" status: 200 len: 194 microversion: 2.1 time: 0.046707 Aug 30 01:07:52.364058 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 365/739] 10.222.0.78 () {58 vars in 1413 bytes} [Tue Aug 30 01:07:52 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-volume_attachments/27c68783-6059-4719-8476-d5457fa12248 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:52.374445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-7d54e657-d58a-4f00-b94d-4929b7913751 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:52.374942 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-7d54e657-d58a-4f00-b94d-4929b7913751 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:52.382202 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7d54e657-d58a-4f00-b94d-4929b7913751 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:52.382690 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7d54e657-d58a-4f00-b94d-4929b7913751 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:52.383128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7d54e657-d58a-4f00-b94d-4929b7913751 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:52.383824 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7d54e657-d58a-4f00-b94d-4929b7913751 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:52.384275 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7d54e657-d58a-4f00-b94d-4929b7913751 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:52.384705 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7d54e657-d58a-4f00-b94d-4929b7913751 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:52.470205 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.objects.instance [None req-7d54e657-d58a-4f00-b94d-4929b7913751 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lazy-loading 'services' on Instance uuid 4992ee7f-4690-467a-ab17-9cd2161482b7 {{(pid=120630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:07:52.544663 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-7d54e657-d58a-4f00-b94d-4929b7913751 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-volume_attachments/27c68783-6059-4719-8476-d5457fa12248" status: 202 len: 0 microversion: 2.1 time: 0.174205 Aug 30 01:07:52.545492 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 375/740] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 30 01:07:52 2022] DELETE /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-volume_attachments/27c68783-6059-4719-8476-d5457fa12248 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:07:53.678019 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-c5c914ce-1a64-4066-adb0-fe2d83996716 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:53.678636 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-c5c914ce-1a64-4066-adb0-fe2d83996716 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:53.684873 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c5c914ce-1a64-4066-adb0-fe2d83996716 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:53.685442 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c5c914ce-1a64-4066-adb0-fe2d83996716 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:53.685888 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c5c914ce-1a64-4066-adb0-fe2d83996716 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:53.686607 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c5c914ce-1a64-4066-adb0-fe2d83996716 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:53.687062 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c5c914ce-1a64-4066-adb0-fe2d83996716 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:53.687493 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c5c914ce-1a64-4066-adb0-fe2d83996716 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:53.721961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-c5c914ce-1a64-4066-adb0-fe2d83996716 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-volume_attachments/ae11cd37-3b66-4677-9158-71725f67dabe" status: 200 len: 194 microversion: 2.1 time: 0.048000 Aug 30 01:07:53.722590 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 366/741] 10.222.0.78 () {58 vars in 1413 bytes} [Tue Aug 30 01:07:53 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-volume_attachments/ae11cd37-3b66-4677-9158-71725f67dabe => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:53.734837 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-e2d9839c-3b87-45ea-863d-e3f87be6d98c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:53.735634 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-e2d9839c-3b87-45ea-863d-e3f87be6d98c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:53.742312 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e2d9839c-3b87-45ea-863d-e3f87be6d98c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:53.743225 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e2d9839c-3b87-45ea-863d-e3f87be6d98c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:53.743491 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e2d9839c-3b87-45ea-863d-e3f87be6d98c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:53.744303 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e2d9839c-3b87-45ea-863d-e3f87be6d98c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:53.744863 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e2d9839c-3b87-45ea-863d-e3f87be6d98c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:53.745430 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e2d9839c-3b87-45ea-863d-e3f87be6d98c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:53.850584 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.objects.instance [None req-e2d9839c-3b87-45ea-863d-e3f87be6d98c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lazy-loading 'services' on Instance uuid 4992ee7f-4690-467a-ab17-9cd2161482b7 {{(pid=120630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:07:53.950595 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-e2d9839c-3b87-45ea-863d-e3f87be6d98c tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-volume_attachments/ae11cd37-3b66-4677-9158-71725f67dabe" status: 202 len: 0 microversion: 2.1 time: 0.220903 Aug 30 01:07:53.952905 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 376/742] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 30 01:07:53 2022] DELETE /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-volume_attachments/ae11cd37-3b66-4677-9158-71725f67dabe => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:07:55.151653 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-caacb7ce-8b73-430f-9dc7-3b0ca2533cb3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:55.154405 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-caacb7ce-8b73-430f-9dc7-3b0ca2533cb3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:55.161676 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-caacb7ce-8b73-430f-9dc7-3b0ca2533cb3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:55.162196 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-caacb7ce-8b73-430f-9dc7-3b0ca2533cb3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:55.162632 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-caacb7ce-8b73-430f-9dc7-3b0ca2533cb3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:55.163337 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-caacb7ce-8b73-430f-9dc7-3b0ca2533cb3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:55.163802 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-caacb7ce-8b73-430f-9dc7-3b0ca2533cb3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:55.164229 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-caacb7ce-8b73-430f-9dc7-3b0ca2533cb3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:55.194149 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:55.202916 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-caacb7ce-8b73-430f-9dc7-3b0ca2533cb3 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055030 Aug 30 01:07:55.203493 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 367/743] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:07:55 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:07:55.329050 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-837bc8b3-ae00-4f4b-8f15-c94698472da9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:55.331296 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-837bc8b3-ae00-4f4b-8f15-c94698472da9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:55.338207 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-837bc8b3-ae00-4f4b-8f15-c94698472da9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:55.338700 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-837bc8b3-ae00-4f4b-8f15-c94698472da9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:55.339137 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-837bc8b3-ae00-4f4b-8f15-c94698472da9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:55.339840 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-837bc8b3-ae00-4f4b-8f15-c94698472da9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:55.340296 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-837bc8b3-ae00-4f4b-8f15-c94698472da9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:55.340720 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-837bc8b3-ae00-4f4b-8f15-c94698472da9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:55.371809 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-837bc8b3-ae00-4f4b-8f15-c94698472da9 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047961 Aug 30 01:07:55.372398 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 377/744] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 30 01:07:55 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:07:55.437485 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-bd4910c9-43b6-4b2f-b56a-4295df49becb tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:55.438002 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-bd4910c9-43b6-4b2f-b56a-4295df49becb tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:55.444907 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-bd4910c9-43b6-4b2f-b56a-4295df49becb tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:55.445413 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-bd4910c9-43b6-4b2f-b56a-4295df49becb tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:55.445843 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-bd4910c9-43b6-4b2f-b56a-4295df49becb tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:55.446527 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-bd4910c9-43b6-4b2f-b56a-4295df49becb tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:55.446974 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-bd4910c9-43b6-4b2f-b56a-4295df49becb tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:55.447394 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-bd4910c9-43b6-4b2f-b56a-4295df49becb tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:55.473139 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-bd4910c9-43b6-4b2f-b56a-4295df49becb tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Going to try to terminate instance {{(pid=120631) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:07:55.555659 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-bd4910c9-43b6-4b2f-b56a-4295df49becb tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7" status: 204 len: 0 microversion: 2.1 time: 0.122294 Aug 30 01:07:55.556583 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 368/745] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:07:55 2022] DELETE /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:07:55.565330 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-db900c6c-f59f-4290-9dfc-11dc35e22825 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:55.566072 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-db900c6c-f59f-4290-9dfc-11dc35e22825 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:55.572498 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-db900c6c-f59f-4290-9dfc-11dc35e22825 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:55.573176 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-db900c6c-f59f-4290-9dfc-11dc35e22825 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:55.573937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-db900c6c-f59f-4290-9dfc-11dc35e22825 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:55.574643 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-db900c6c-f59f-4290-9dfc-11dc35e22825 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:55.575258 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-db900c6c-f59f-4290-9dfc-11dc35e22825 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:55.576481 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-db900c6c-f59f-4290-9dfc-11dc35e22825 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:55.712046 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-db900c6c-f59f-4290-9dfc-11dc35e22825 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:55.720439 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-db900c6c-f59f-4290-9dfc-11dc35e22825 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7" status: 200 len: 1675 microversion: 2.1 time: 0.159070 Aug 30 01:07:55.721013 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 378/746] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:55 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:07:56.742510 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-6a0c16ba-e097-4421-b1b2-36d8ebeb17d4 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:56.743215 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-6a0c16ba-e097-4421-b1b2-36d8ebeb17d4 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:56.749769 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6a0c16ba-e097-4421-b1b2-36d8ebeb17d4 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:56.750255 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6a0c16ba-e097-4421-b1b2-36d8ebeb17d4 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:56.750690 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6a0c16ba-e097-4421-b1b2-36d8ebeb17d4 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:56.751390 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6a0c16ba-e097-4421-b1b2-36d8ebeb17d4 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:56.751900 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6a0c16ba-e097-4421-b1b2-36d8ebeb17d4 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:56.752326 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6a0c16ba-e097-4421-b1b2-36d8ebeb17d4 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:56.887469 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6a0c16ba-e097-4421-b1b2-36d8ebeb17d4 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:56.896728 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-6a0c16ba-e097-4421-b1b2-36d8ebeb17d4 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7" status: 200 len: 1675 microversion: 2.1 time: 0.158372 Aug 30 01:07:56.897333 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 369/747] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:56 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:07:57.665470 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-194a972e-fed7-4496-9c5b-792eaf71fd46 tempest-VolumesTestJSON-212572805 tempest-VolumesTestJSON-212572805-project] Calling method '.version_select at 0x7f0f5257fb80>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:57.715316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-194a972e-fed7-4496-9c5b-792eaf71fd46 tempest-VolumesTestJSON-212572805 tempest-VolumesTestJSON-212572805-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/ded564bb-9882-4b9c-a2d5-b739caf04cba" status: 200 len: 351 microversion: 2.1 time: 0.053502 Aug 30 01:07:57.715886 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 379/748] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 30 01:07:57 2022] GET /compute/v2.1/os-volumes/ded564bb-9882-4b9c-a2d5-b739caf04cba => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:57.918896 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-d8f23bd0-d57e-432c-823f-da72a67a2b71 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:57.920677 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-d8f23bd0-d57e-432c-823f-da72a67a2b71 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:57.923645 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:57.927199 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d8f23bd0-d57e-432c-823f-da72a67a2b71 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:57.927690 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d8f23bd0-d57e-432c-823f-da72a67a2b71 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:57.928133 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d8f23bd0-d57e-432c-823f-da72a67a2b71 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:57.928843 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d8f23bd0-d57e-432c-823f-da72a67a2b71 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:57.929351 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d8f23bd0-d57e-432c-823f-da72a67a2b71 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:57.929781 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d8f23bd0-d57e-432c-823f-da72a67a2b71 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:58.084736 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-d8f23bd0-d57e-432c-823f-da72a67a2b71 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:58.093474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-d8f23bd0-d57e-432c-823f-da72a67a2b71 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7" status: 200 len: 1675 microversion: 2.1 time: 0.178646 Aug 30 01:07:58.094156 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 370/749] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:57 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 => generated 1675 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:07:58.538102 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-5fe0c8dd-9765-4038-b6d3-b331f09a9a93 req-5c1305e5-4d0c-4e5e-a3f9-36b027d741df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4992ee7f-4690-467a-ab17-9cd2161482b7", "name": "network-vif-deleted", "tag": "b6a65e7b-a007-4ec5-97e9-6d73e85712b7"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:07:58.546776 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:58.555639 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-5fe0c8dd-9765-4038-b6d3-b331f09a9a93 req-5c1305e5-4d0c-4e5e-a3f9-36b027d741df service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:58.556127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-5fe0c8dd-9765-4038-b6d3-b331f09a9a93 req-5c1305e5-4d0c-4e5e-a3f9-36b027d741df service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:58.556676 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-5fe0c8dd-9765-4038-b6d3-b331f09a9a93 req-5c1305e5-4d0c-4e5e-a3f9-36b027d741df service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:58.570738 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-5fe0c8dd-9765-4038-b6d3-b331f09a9a93 req-5c1305e5-4d0c-4e5e-a3f9-36b027d741df service nova] Creating event network-vif-deleted:b6a65e7b-a007-4ec5-97e9-6d73e85712b7 for instance 4992ee7f-4690-467a-ab17-9cd2161482b7 on hv-cinder-81514 Aug 30 01:07:58.576737 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-5fe0c8dd-9765-4038-b6d3-b331f09a9a93 req-5c1305e5-4d0c-4e5e-a3f9-36b027d741df service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042040 Aug 30 01:07:58.577429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 380/750] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:59.077535 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-adde0813-e86d-4895-aea6-987909222d00 tempest-VolumesTestJSON-212572805 tempest-VolumesTestJSON-212572805-project] Calling method '.version_select at 0x7f0f528b0af0>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:59.116768 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4dd44fa9-47e5-4de4-8b5e-f4c04462ef51 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:59.117505 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-4dd44fa9-47e5-4de4-8b5e-f4c04462ef51 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:59.126988 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4dd44fa9-47e5-4de4-8b5e-f4c04462ef51 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:59.127502 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4dd44fa9-47e5-4de4-8b5e-f4c04462ef51 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:59.127948 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4dd44fa9-47e5-4de4-8b5e-f4c04462ef51 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:59.128659 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4dd44fa9-47e5-4de4-8b5e-f4c04462ef51 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:59.129144 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4dd44fa9-47e5-4de4-8b5e-f4c04462ef51 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:59.129570 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-adde0813-e86d-4895-aea6-987909222d00 tempest-VolumesTestJSON-212572805 tempest-VolumesTestJSON-212572805-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d42e7eb3-c349-4f99-b48b-2ffcb37081b8" status: 200 len: 351 microversion: 2.1 time: 0.056569 Aug 30 01:07:59.129685 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4dd44fa9-47e5-4de4-8b5e-f4c04462ef51 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:59.130140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 371/751] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 30 01:07:59 2022] GET /compute/v2.1/os-volumes/d42e7eb3-c349-4f99-b48b-2ffcb37081b8 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:59.176636 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4dd44fa9-47e5-4de4-8b5e-f4c04462ef51 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:59.177136 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4dd44fa9-47e5-4de4-8b5e-f4c04462ef51 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:59.177588 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4dd44fa9-47e5-4de4-8b5e-f4c04462ef51 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:59.178715 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.objects.instance [None req-4dd44fa9-47e5-4de4-8b5e-f4c04462ef51 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lazy-loading 'fault' on Instance uuid 4992ee7f-4690-467a-ab17-9cd2161482b7 {{(pid=120630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:07:59.239100 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-4dd44fa9-47e5-4de4-8b5e-f4c04462ef51 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe0e0033de447da70be9bc0228eba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40b3e29a18b48cba6800c9f3a0dfee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:59.246690 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-4dd44fa9-47e5-4de4-8b5e-f4c04462ef51 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7" status: 200 len: 1328 microversion: 2.1 time: 0.134412 Aug 30 01:07:59.249042 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 381/752] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:59 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 => generated 1328 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:08:00.128222 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0536e93b-4a51-43d1-a9d7-f6670bff905e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:00.128791 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-0536e93b-4a51-43d1-a9d7-f6670bff905e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:00.135800 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0536e93b-4a51-43d1-a9d7-f6670bff905e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:00.136275 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0536e93b-4a51-43d1-a9d7-f6670bff905e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:00.136706 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0536e93b-4a51-43d1-a9d7-f6670bff905e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:00.137418 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0536e93b-4a51-43d1-a9d7-f6670bff905e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:00.138048 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0536e93b-4a51-43d1-a9d7-f6670bff905e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:00.138479 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0536e93b-4a51-43d1-a9d7-f6670bff905e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:00.168746 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0536e93b-4a51-43d1-a9d7-f6670bff905e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255/ips" status: 200 len: 152 microversion: 2.20 time: 0.046476 Aug 30 01:08:00.169996 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 372/753] 10.222.0.78 () {60 vars in 1289 bytes} [Tue Aug 30 01:08:00 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255/ips => generated 152 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:08:00.270255 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-49b2c988-f063-44fd-af3b-6662cac35f9a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:00.270869 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-49b2c988-f063-44fd-af3b-6662cac35f9a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:00.277248 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-49b2c988-f063-44fd-af3b-6662cac35f9a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:00.277736 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-49b2c988-f063-44fd-af3b-6662cac35f9a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:00.278174 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-49b2c988-f063-44fd-af3b-6662cac35f9a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:00.279884 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-49b2c988-f063-44fd-af3b-6662cac35f9a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:00.280360 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-49b2c988-f063-44fd-af3b-6662cac35f9a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:00.281046 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-49b2c988-f063-44fd-af3b-6662cac35f9a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:00.295847 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-49b2c988-f063-44fd-af3b-6662cac35f9a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] HTTP exception thrown: Instance 4992ee7f-4690-467a-ab17-9cd2161482b7 could not be found. Aug 30 01:08:00.297509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-49b2c988-f063-44fd-af3b-6662cac35f9a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Request method failure captured: Aug 30 01:08:00.297509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 HTTP/1.1 Aug 30 01:08:00.297509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:08:00.297509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:08:00.297509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:08:00.297509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:08:00.297509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:08:00.297509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:08:00.297509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:08:00.297509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:08:00.297509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWFdvGLGGrrzeBRj1xCnzWHvxtL2jI7lW1boDKifREfYH0T80DE0HQj1uxS2XHMB3h7wUIsW8tHd958F2-_vvvA-XoRij44TrLoTFedHOEbOxJ0RQoSO1UK0ktOb3rcbW4EdIMG8DRpVyK6sJGj07FacPpoWxGKqUZmdj_JYlTyAnHk Aug 30 01:08:00.297509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:08:00.297509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:08:00.297509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:08:00.297509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:08:00.297509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:08:00.297509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:08:00.297509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: f40b3e29a18b48cba6800c9f3a0dfee9 Aug 30 01:08:00.297509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-AttachVolumeTestJSON-936502140 Aug 30 01:08:00.297509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:08:00.297509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:08:00.299052 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f40b3e29a18b48cba6800c9f3a0dfee9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f40b3e29a18b48cba6800c9f3a0dfee9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f40b3e29a18b48cba6800c9f3a0dfee9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f40b3e29a18b48cba6800c9f3a0dfee9"}]}] Aug 30 01:08:00.299052 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-AttachVolumeTestJSON-936502140 Aug 30 01:08:00.299052 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: f40b3e29a18b48cba6800c9f3a0dfee9 Aug 30 01:08:00.299052 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-AttachVolumeTestJSON-936502140 Aug 30 01:08:00.299052 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-AttachVolumeTestJSON-936502140-project Aug 30 01:08:00.299052 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:08:00.299052 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:08:00.299052 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: c6fe0e0033de447da70be9bc0228eba2 Aug 30 01:08:00.299052 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-AttachVolumeTestJSON-936502140-project Aug 30 01:08:00.299052 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:08:00.299052 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Instance 4992ee7f-4690-467a-ab17-9cd2161482b7 could not be found. Aug 30 01:08:00.299052 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': '4992ee7f-4690-467a-ab17-9cd2161482b7'} Aug 30 01:08:00.299845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:08:00.299845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:08:00.299845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:08:00.299845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:08:00.299845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:08:00.299845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:08:00.299845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:08:00.299845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:08:00.299845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:08:00.299845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:08:00.299845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4992ee7f-4690-467a-ab17-9cd2161482b7 could not be found. Aug 30 01:08:00.299845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:08:00.299845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:08:00.299845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:08:00.299845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:08:00.299845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:08:00.299845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:08:00.299845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:08:00.299845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:08:00.299845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:08:00.301127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:08:00.301127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:08:00.301127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:08:00.301127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:08:00.301127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:08:00.301127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:08:00.301127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:08:00.301127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4992ee7f-4690-467a-ab17-9cd2161482b7 could not be found. Aug 30 01:08:00.301127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:08:00.301127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:08:00.301127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:08:00.301127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:08:00.301127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:08:00.301127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:08:00.301127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:08:00.301127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:08:00.301127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4992ee7f-4690-467a-ab17-9cd2161482b7 could not be found. Aug 30 01:08:00.301127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:08:00.302213 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-49b2c988-f063-44fd-af3b-6662cac35f9a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Returning 404 to user: Instance 4992ee7f-4690-467a-ab17-9cd2161482b7 could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:08:00.302213 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-49b2c988-f063-44fd-af3b-6662cac35f9a tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7" status: 404 len: 111 microversion: 2.1 time: 0.032502 Aug 30 01:08:00.302213 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 382/754] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:08:00 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:08:00.309820 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-6a501257-f4fe-44eb-a05d-e7292ebf2e32 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '.version_select at 0x7f0f5261ae50>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:00.333161 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-6a501257-f4fe-44eb-a05d-e7292ebf2e32 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1716051925" status: 202 len: 0 microversion: 2.1 time: 0.028496 Aug 30 01:08:00.334223 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 373/755] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Aug 30 01:08:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1716051925 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:08:00.547625 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f2a9ee09-3f20-4dfa-8401-6dc3870c79e1 tempest-VolumesTestJSON-212572805 tempest-VolumesTestJSON-212572805-project] Calling method '.version_select at 0x7f0f525cd700>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:00.599760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-f2a9ee09-3f20-4dfa-8401-6dc3870c79e1 tempest-VolumesTestJSON-212572805 tempest-VolumesTestJSON-212572805-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/eb11f239-7748-44e4-982d-e4b853159dfd" status: 200 len: 351 microversion: 2.1 time: 0.057231 Aug 30 01:08:00.600322 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 383/756] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 30 01:08:00 2022] GET /compute/v2.1/os-volumes/eb11f239-7748-44e4-982d-e4b853159dfd => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:08:00.613833 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-2b8bce67-60f4-451b-a746-26935de759d1 tempest-VolumesTestJSON-212572805 tempest-VolumesTestJSON-212572805-project] Calling method '.version_select at 0x7f0f526623a0>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:00.697407 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-2b8bce67-60f4-451b-a746-26935de759d1 tempest-VolumesTestJSON-212572805 tempest-VolumesTestJSON-212572805-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.087219 Aug 30 01:08:00.697982 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 374/757] 10.222.0.78 () {58 vars in 1134 bytes} [Tue Aug 30 01:08:00 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:08:00.712148 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-2be2a125-2b5d-4747-b095-6276bba0adb1 tempest-VolumesTestJSON-212572805 tempest-VolumesTestJSON-212572805-project] Calling method '.version_select at 0x7f0f525e4ee0>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:00.812545 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-2be2a125-2b5d-4747-b095-6276bba0adb1 tempest-VolumesTestJSON-212572805 tempest-VolumesTestJSON-212572805-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.104245 Aug 30 01:08:00.813193 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 384/758] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Aug 30 01:08:00 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:08:00.828113 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-5912bbbe-4304-4744-8550-4fd82e5fd1a7 tempest-VolumesTestJSON-212572805 tempest-VolumesTestJSON-212572805-project] Calling method '.version_select at 0x7f0f5262ea60>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:00.920826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-5912bbbe-4304-4744-8550-4fd82e5fd1a7 tempest-VolumesTestJSON-212572805 tempest-VolumesTestJSON-212572805-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.097372 Aug 30 01:08:00.921438 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 375/759] 10.222.0.78 () {58 vars in 1134 bytes} [Tue Aug 30 01:08:00 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:08:00.934292 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-d266d165-0dbe-4855-9026-678a2e67e776 tempest-VolumesTestJSON-212572805 tempest-VolumesTestJSON-212572805-project] Calling method '.version_select at 0x7f0f52584160>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:01.020520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-d266d165-0dbe-4855-9026-678a2e67e776 tempest-VolumesTestJSON-212572805 tempest-VolumesTestJSON-212572805-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089967 Aug 30 01:08:01.021130 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 385/760] 10.222.0.78 () {58 vars in 1167 bytes} [Tue Aug 30 01:08:00 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:08:01.039026 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-4b8ebc38-9aa5-4f52-9cf8-4deeb5163408 tempest-VolumesTestJSON-212572805 tempest-VolumesTestJSON-212572805-project] Calling method '.version_select at 0x7f0f5262ec10>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:01.127075 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-4b8ebc38-9aa5-4f52-9cf8-4deeb5163408 tempest-VolumesTestJSON-212572805 tempest-VolumesTestJSON-212572805-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.096514 Aug 30 01:08:01.127651 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 376/761] 10.222.0.78 () {58 vars in 1170 bytes} [Tue Aug 30 01:08:01 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:08:01.141115 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-97fa4c74-6a08-4e18-a2e3-521f00f7e598 tempest-VolumesTestJSON-212572805 tempest-VolumesTestJSON-212572805-project] Calling method '.version_select at 0x7f0f5257fb80>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:01.225213 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-97fa4c74-6a08-4e18-a2e3-521f00f7e598 tempest-VolumesTestJSON-212572805 tempest-VolumesTestJSON-212572805-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.088487 Aug 30 01:08:01.225792 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 386/762] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Aug 30 01:08:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:08:01.239184 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-32678097-3213-4f00-a54f-00a00fcb31f0 tempest-VolumesTestJSON-212572805 tempest-VolumesTestJSON-212572805-project] Calling method '.version_select at 0x7f0f526cad30>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:01.328026 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-32678097-3213-4f00-a54f-00a00fcb31f0 tempest-VolumesTestJSON-212572805 tempest-VolumesTestJSON-212572805-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.092995 Aug 30 01:08:01.328622 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 377/763] 10.222.0.78 () {58 vars in 1188 bytes} [Tue Aug 30 01:08:01 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:08:01.342400 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f723c6a0-1b46-4c0c-a022-d0452013c52e tempest-VolumesTestJSON-212572805 tempest-VolumesTestJSON-212572805-project] Calling method '.version_select at 0x7f0f525840d0>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:01.425833 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-f723c6a0-1b46-4c0c-a022-d0452013c52e tempest-VolumesTestJSON-212572805 tempest-VolumesTestJSON-212572805-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.088344 Aug 30 01:08:01.426563 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 387/764] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Aug 30 01:08:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:08:01.969855 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-9f98fa25-5452-416e-a468-82d0b41d3383 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:08:01.970561 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-9f98fa25-5452-416e-a468-82d0b41d3383 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:01.976665 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9f98fa25-5452-416e-a468-82d0b41d3383 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:01.977104 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9f98fa25-5452-416e-a468-82d0b41d3383 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:01.977534 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9f98fa25-5452-416e-a468-82d0b41d3383 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:01.978234 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9f98fa25-5452-416e-a468-82d0b41d3383 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:01.978663 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9f98fa25-5452-416e-a468-82d0b41d3383 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:01.979079 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9f98fa25-5452-416e-a468-82d0b41d3383 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:02.001227 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.objects.instance [None req-9f98fa25-5452-416e-a468-82d0b41d3383 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lazy-loading 'flavor' on Instance uuid 8f9b5386-7fbc-4d22-a388-55c656bf9255 {{(pid=120631) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:08:02.189658 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-9f98fa25-5452-416e-a468-82d0b41d3383 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "POST /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255/action" status: 202 len: 0 microversion: 2.20 time: 0.224385 Aug 30 01:08:02.193546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 378/765] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Aug 30 01:08:01 2022] POST /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:08:02.199046 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8e6d6f8d-75f6-42aa-87c2-78cbaa5390a9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:02.199759 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8e6d6f8d-75f6-42aa-87c2-78cbaa5390a9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:02.208722 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8e6d6f8d-75f6-42aa-87c2-78cbaa5390a9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:02.208722 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8e6d6f8d-75f6-42aa-87c2-78cbaa5390a9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:02.208946 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8e6d6f8d-75f6-42aa-87c2-78cbaa5390a9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:02.209736 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8e6d6f8d-75f6-42aa-87c2-78cbaa5390a9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:02.210195 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8e6d6f8d-75f6-42aa-87c2-78cbaa5390a9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:02.210852 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8e6d6f8d-75f6-42aa-87c2-78cbaa5390a9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:02.350417 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8e6d6f8d-75f6-42aa-87c2-78cbaa5390a9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:02.359711 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8e6d6f8d-75f6-42aa-87c2-78cbaa5390a9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:02.361220 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8e6d6f8d-75f6-42aa-87c2-78cbaa5390a9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:02.362489 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8e6d6f8d-75f6-42aa-87c2-78cbaa5390a9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1722 microversion: 2.20 time: 0.167600 Aug 30 01:08:02.363100 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 388/766] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:02 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:03.313054 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-f8d93ce2-55d9-4e09-8f2f-25085530f0a5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:03.313791 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-f8d93ce2-55d9-4e09-8f2f-25085530f0a5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:03.320177 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f8d93ce2-55d9-4e09-8f2f-25085530f0a5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:03.320657 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f8d93ce2-55d9-4e09-8f2f-25085530f0a5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:03.321114 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f8d93ce2-55d9-4e09-8f2f-25085530f0a5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:03.321811 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f8d93ce2-55d9-4e09-8f2f-25085530f0a5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:03.322260 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f8d93ce2-55d9-4e09-8f2f-25085530f0a5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:03.322679 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f8d93ce2-55d9-4e09-8f2f-25085530f0a5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:03.336522 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-f8d93ce2-55d9-4e09-8f2f-25085530f0a5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] HTTP exception thrown: Instance 4992ee7f-4690-467a-ab17-9cd2161482b7 could not be found. Aug 30 01:08:03.338173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-f8d93ce2-55d9-4e09-8f2f-25085530f0a5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Request method failure captured: Aug 30 01:08:03.338173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: DELETE /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 HTTP/1.1 Aug 30 01:08:03.338173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:08:03.338173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:08:03.338173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:08:03.338173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:08:03.338173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:08:03.338173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:08:03.338173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:08:03.338173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:08:03.338173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWFdvGLGGrrzeBRj1xCnzWHvxtL2jI7lW1boDKifREfYH0T80DE0HQj1uxS2XHMB3h7wUIsW8tHd958F2-_vvvA-XoRij44TrLoTFedHOEbOxJ0RQoSO1UK0ktOb3rcbW4EdIMG8DRpVyK6sJGj07FacPpoWxGKqUZmdj_JYlTyAnHk Aug 30 01:08:03.338173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:08:03.338173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:08:03.338173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:08:03.338173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:08:03.338173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:08:03.338173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:08:03.338173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: f40b3e29a18b48cba6800c9f3a0dfee9 Aug 30 01:08:03.338173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-AttachVolumeTestJSON-936502140 Aug 30 01:08:03.338173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:08:03.338173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:08:03.339787 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f40b3e29a18b48cba6800c9f3a0dfee9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f40b3e29a18b48cba6800c9f3a0dfee9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f40b3e29a18b48cba6800c9f3a0dfee9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f40b3e29a18b48cba6800c9f3a0dfee9"}]}] Aug 30 01:08:03.339787 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-AttachVolumeTestJSON-936502140 Aug 30 01:08:03.339787 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: f40b3e29a18b48cba6800c9f3a0dfee9 Aug 30 01:08:03.339787 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-AttachVolumeTestJSON-936502140 Aug 30 01:08:03.339787 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-AttachVolumeTestJSON-936502140-project Aug 30 01:08:03.339787 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:08:03.339787 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:08:03.339787 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: c6fe0e0033de447da70be9bc0228eba2 Aug 30 01:08:03.339787 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-AttachVolumeTestJSON-936502140-project Aug 30 01:08:03.339787 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:08:03.339787 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Instance 4992ee7f-4690-467a-ab17-9cd2161482b7 could not be found. Aug 30 01:08:03.339787 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': '4992ee7f-4690-467a-ab17-9cd2161482b7'} Aug 30 01:08:03.340874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:08:03.340874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:08:03.340874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:08:03.340874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:08:03.340874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:08:03.340874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:08:03.340874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:08:03.340874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:08:03.340874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:08:03.340874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:08:03.340874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4992ee7f-4690-467a-ab17-9cd2161482b7 could not be found. Aug 30 01:08:03.340874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:08:03.340874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:08:03.340874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:08:03.340874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:08:03.340874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:08:03.340874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:08:03.340874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:08:03.340874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:08:03.340874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:08:03.343655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:08:03.343655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:08:03.343655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:08:03.343655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:08:03.343655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:08:03.343655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:08:03.343655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:08:03.343655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:08:03.343655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:08:03.343655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4992ee7f-4690-467a-ab17-9cd2161482b7 could not be found. Aug 30 01:08:03.343655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:08:03.343655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:08:03.343655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:08:03.343655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:08:03.343655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:08:03.343655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:08:03.343655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:08:03.343655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:08:03.343655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4992ee7f-4690-467a-ab17-9cd2161482b7 could not be found. Aug 30 01:08:03.343655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:08:03.345243 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-f8d93ce2-55d9-4e09-8f2f-25085530f0a5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Returning 404 to user: Instance 4992ee7f-4690-467a-ab17-9cd2161482b7 could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:08:03.345243 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-f8d93ce2-55d9-4e09-8f2f-25085530f0a5 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7" status: 404 len: 111 microversion: 2.1 time: 0.032140 Aug 30 01:08:03.345243 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 379/767] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:08:03 2022] DELETE /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:08:03.348577 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-0ee25f5e-640a-4290-9427-2da0de323c6d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:03.349215 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-0ee25f5e-640a-4290-9427-2da0de323c6d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: 4992ee7f-4690-467a-ab17-9cd2161482b7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:03.355229 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0ee25f5e-640a-4290-9427-2da0de323c6d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:03.355807 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0ee25f5e-640a-4290-9427-2da0de323c6d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:03.356123 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0ee25f5e-640a-4290-9427-2da0de323c6d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:03.356801 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0ee25f5e-640a-4290-9427-2da0de323c6d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:03.357291 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0ee25f5e-640a-4290-9427-2da0de323c6d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:03.357794 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0ee25f5e-640a-4290-9427-2da0de323c6d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:03.370723 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-0ee25f5e-640a-4290-9427-2da0de323c6d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] HTTP exception thrown: Instance 4992ee7f-4690-467a-ab17-9cd2161482b7 could not be found. Aug 30 01:08:03.372217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-0ee25f5e-640a-4290-9427-2da0de323c6d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Request method failure captured: Aug 30 01:08:03.372217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 HTTP/1.1 Aug 30 01:08:03.372217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:08:03.372217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:08:03.372217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:08:03.372217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:08:03.372217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:08:03.372217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:08:03.372217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:08:03.372217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:08:03.372217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWFdvGLGGrrzeBRj1xCnzWHvxtL2jI7lW1boDKifREfYH0T80DE0HQj1uxS2XHMB3h7wUIsW8tHd958F2-_vvvA-XoRij44TrLoTFedHOEbOxJ0RQoSO1UK0ktOb3rcbW4EdIMG8DRpVyK6sJGj07FacPpoWxGKqUZmdj_JYlTyAnHk Aug 30 01:08:03.372217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:08:03.372217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:08:03.372217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:08:03.372217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:08:03.372217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:08:03.372217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:08:03.372217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: f40b3e29a18b48cba6800c9f3a0dfee9 Aug 30 01:08:03.372217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-AttachVolumeTestJSON-936502140 Aug 30 01:08:03.372217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:08:03.372217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:08:03.373871 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f40b3e29a18b48cba6800c9f3a0dfee9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f40b3e29a18b48cba6800c9f3a0dfee9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f40b3e29a18b48cba6800c9f3a0dfee9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f40b3e29a18b48cba6800c9f3a0dfee9"}]}] Aug 30 01:08:03.373871 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-AttachVolumeTestJSON-936502140 Aug 30 01:08:03.373871 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: f40b3e29a18b48cba6800c9f3a0dfee9 Aug 30 01:08:03.373871 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-AttachVolumeTestJSON-936502140 Aug 30 01:08:03.373871 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-AttachVolumeTestJSON-936502140-project Aug 30 01:08:03.373871 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:08:03.373871 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:08:03.373871 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: c6fe0e0033de447da70be9bc0228eba2 Aug 30 01:08:03.373871 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-AttachVolumeTestJSON-936502140-project Aug 30 01:08:03.373871 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:08:03.373871 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Instance 4992ee7f-4690-467a-ab17-9cd2161482b7 could not be found. Aug 30 01:08:03.373871 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': '4992ee7f-4690-467a-ab17-9cd2161482b7'} Aug 30 01:08:03.374800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:08:03.374800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:08:03.374800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:08:03.374800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:08:03.374800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:08:03.374800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:08:03.374800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:08:03.374800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:08:03.374800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:08:03.374800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:08:03.374800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4992ee7f-4690-467a-ab17-9cd2161482b7 could not be found. Aug 30 01:08:03.374800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:08:03.374800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:08:03.374800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:08:03.374800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:08:03.374800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:08:03.374800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:08:03.374800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:08:03.374800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:08:03.374800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:08:03.375985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:08:03.375985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:08:03.375985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:08:03.375985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:08:03.375985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:08:03.375985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:08:03.375985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:08:03.375985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4992ee7f-4690-467a-ab17-9cd2161482b7 could not be found. Aug 30 01:08:03.375985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:08:03.375985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:08:03.375985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:08:03.375985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:08:03.375985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:08:03.375985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:08:03.375985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:08:03.375985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:08:03.375985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4992ee7f-4690-467a-ab17-9cd2161482b7 could not be found. Aug 30 01:08:03.375985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:08:03.377458 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-0ee25f5e-640a-4290-9427-2da0de323c6d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Returning 404 to user: Instance 4992ee7f-4690-467a-ab17-9cd2161482b7 could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:08:03.377458 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-0ee25f5e-640a-4290-9427-2da0de323c6d tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7" status: 404 len: 111 microversion: 2.1 time: 0.028791 Aug 30 01:08:03.377458 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 389/768] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:08:03 2022] GET /compute/v2.1/servers/4992ee7f-4690-467a-ab17-9cd2161482b7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:08:03.387317 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-4fad5842-d842-42fc-81ce-369909d09c71 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:03.387926 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-4fad5842-d842-42fc-81ce-369909d09c71 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:03.394525 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4fad5842-d842-42fc-81ce-369909d09c71 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:03.395099 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4fad5842-d842-42fc-81ce-369909d09c71 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:03.395528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4fad5842-d842-42fc-81ce-369909d09c71 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:03.396250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4fad5842-d842-42fc-81ce-369909d09c71 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:03.396698 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4fad5842-d842-42fc-81ce-369909d09c71 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:03.397135 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4fad5842-d842-42fc-81ce-369909d09c71 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:03.537910 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-4fad5842-d842-42fc-81ce-369909d09c71 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:03.546678 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-4fad5842-d842-42fc-81ce-369909d09c71 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:03.548172 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-4fad5842-d842-42fc-81ce-369909d09c71 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:03.549368 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-4fad5842-d842-42fc-81ce-369909d09c71 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1722 microversion: 2.20 time: 0.166058 Aug 30 01:08:03.549922 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 380/769] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:03 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:04.516618 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-340d8e41-83f3-4d25-a678-1f7e05cc12db tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:04.517142 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-340d8e41-83f3-4d25-a678-1f7e05cc12db tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:04.523697 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-340d8e41-83f3-4d25-a678-1f7e05cc12db tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:04.524176 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-340d8e41-83f3-4d25-a678-1f7e05cc12db tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:04.524605 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-340d8e41-83f3-4d25-a678-1f7e05cc12db tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:04.525312 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-340d8e41-83f3-4d25-a678-1f7e05cc12db tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:04.525761 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-340d8e41-83f3-4d25-a678-1f7e05cc12db tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:04.526179 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-340d8e41-83f3-4d25-a678-1f7e05cc12db tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:04.541407 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-340d8e41-83f3-4d25-a678-1f7e05cc12db tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] HTTP exception thrown: Instance b59fedac-4fcb-47a8-8187-0a331d499fd2 could not be found. Aug 30 01:08:04.542929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-340d8e41-83f3-4d25-a678-1f7e05cc12db tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Request method failure captured: Aug 30 01:08:04.542929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: DELETE /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 HTTP/1.1 Aug 30 01:08:04.542929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:08:04.542929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:08:04.542929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:08:04.542929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:08:04.542929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:08:04.542929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:08:04.542929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:08:04.542929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:08:04.542929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWFdvGLGGrrzeBRj1xCnzWHvxtL2jI7lW1boDKifREfYH0T80DE0HQj1uxS2XHMB3h7wUIsW8tHd958F2-_vvvA-XoRij44TrLoTFedHOEbOxJ0RQoSO1UK0ktOb3rcbW4EdIMG8DRpVyK6sJGj07FacPpoWxGKqUZmdj_JYlTyAnHk Aug 30 01:08:04.542929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:08:04.542929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:08:04.542929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:08:04.542929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:08:04.542929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:08:04.542929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:08:04.542929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: f40b3e29a18b48cba6800c9f3a0dfee9 Aug 30 01:08:04.542929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-AttachVolumeTestJSON-936502140 Aug 30 01:08:04.542929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:08:04.542929 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:08:04.544415 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f40b3e29a18b48cba6800c9f3a0dfee9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f40b3e29a18b48cba6800c9f3a0dfee9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f40b3e29a18b48cba6800c9f3a0dfee9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f40b3e29a18b48cba6800c9f3a0dfee9"}]}] Aug 30 01:08:04.544415 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-AttachVolumeTestJSON-936502140 Aug 30 01:08:04.544415 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: f40b3e29a18b48cba6800c9f3a0dfee9 Aug 30 01:08:04.544415 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-AttachVolumeTestJSON-936502140 Aug 30 01:08:04.544415 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-AttachVolumeTestJSON-936502140-project Aug 30 01:08:04.544415 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:08:04.544415 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:08:04.544415 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: c6fe0e0033de447da70be9bc0228eba2 Aug 30 01:08:04.544415 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-AttachVolumeTestJSON-936502140-project Aug 30 01:08:04.544415 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:08:04.544415 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Instance b59fedac-4fcb-47a8-8187-0a331d499fd2 could not be found. Aug 30 01:08:04.544415 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': 'b59fedac-4fcb-47a8-8187-0a331d499fd2'} Aug 30 01:08:04.546005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:08:04.546005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:08:04.546005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:08:04.546005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:08:04.546005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:08:04.546005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:08:04.546005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:08:04.546005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:08:04.546005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:08:04.546005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:08:04.546005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b59fedac-4fcb-47a8-8187-0a331d499fd2 could not be found. Aug 30 01:08:04.546005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:08:04.546005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:08:04.546005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:08:04.546005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:08:04.546005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:08:04.546005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:08:04.546005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:08:04.546005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:08:04.546005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:08:04.547533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:08:04.547533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:08:04.547533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:08:04.547533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:08:04.547533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:08:04.547533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:08:04.547533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:08:04.547533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:08:04.547533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:08:04.547533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b59fedac-4fcb-47a8-8187-0a331d499fd2 could not be found. Aug 30 01:08:04.547533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:08:04.547533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:08:04.547533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:08:04.547533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:08:04.547533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:08:04.547533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:08:04.547533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:08:04.547533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:08:04.547533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b59fedac-4fcb-47a8-8187-0a331d499fd2 could not be found. Aug 30 01:08:04.547533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:08:04.548887 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-340d8e41-83f3-4d25-a678-1f7e05cc12db tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Returning 404 to user: Instance b59fedac-4fcb-47a8-8187-0a331d499fd2 could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:08:04.548887 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-340d8e41-83f3-4d25-a678-1f7e05cc12db tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 404 len: 111 microversion: 2.1 time: 0.031607 Aug 30 01:08:04.548887 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 390/770] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:08:04 2022] DELETE /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:08:04.553494 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-660aade2-6beb-428e-8a68-f3aa23ab8705 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:04.554103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-660aade2-6beb-428e-8a68-f3aa23ab8705 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] [instance: b59fedac-4fcb-47a8-8187-0a331d499fd2] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:04.560362 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-660aade2-6beb-428e-8a68-f3aa23ab8705 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:04.560861 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-660aade2-6beb-428e-8a68-f3aa23ab8705 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:04.561332 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-660aade2-6beb-428e-8a68-f3aa23ab8705 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:04.562008 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-660aade2-6beb-428e-8a68-f3aa23ab8705 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:04.562457 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-660aade2-6beb-428e-8a68-f3aa23ab8705 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:04.562871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-660aade2-6beb-428e-8a68-f3aa23ab8705 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:04.571523 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-603779cf-c79d-458f-bee6-353b6507353a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:04.572162 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-603779cf-c79d-458f-bee6-353b6507353a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:04.576006 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-660aade2-6beb-428e-8a68-f3aa23ab8705 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] HTTP exception thrown: Instance b59fedac-4fcb-47a8-8187-0a331d499fd2 could not be found. Aug 30 01:08:04.577743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-660aade2-6beb-428e-8a68-f3aa23ab8705 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Request method failure captured: Aug 30 01:08:04.577743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 HTTP/1.1 Aug 30 01:08:04.577743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:08:04.577743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:08:04.577743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:08:04.577743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:08:04.577743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:08:04.577743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:08:04.577743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:08:04.577743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:08:04.577743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWFdvGLGGrrzeBRj1xCnzWHvxtL2jI7lW1boDKifREfYH0T80DE0HQj1uxS2XHMB3h7wUIsW8tHd958F2-_vvvA-XoRij44TrLoTFedHOEbOxJ0RQoSO1UK0ktOb3rcbW4EdIMG8DRpVyK6sJGj07FacPpoWxGKqUZmdj_JYlTyAnHk Aug 30 01:08:04.577743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:08:04.577743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:08:04.577743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:08:04.577743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:08:04.577743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:08:04.577743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:08:04.577743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: f40b3e29a18b48cba6800c9f3a0dfee9 Aug 30 01:08:04.577743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-AttachVolumeTestJSON-936502140 Aug 30 01:08:04.577743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:08:04.577743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:08:04.579257 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f40b3e29a18b48cba6800c9f3a0dfee9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f40b3e29a18b48cba6800c9f3a0dfee9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f40b3e29a18b48cba6800c9f3a0dfee9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f40b3e29a18b48cba6800c9f3a0dfee9"}]}] Aug 30 01:08:04.579257 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-AttachVolumeTestJSON-936502140 Aug 30 01:08:04.579257 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: f40b3e29a18b48cba6800c9f3a0dfee9 Aug 30 01:08:04.579257 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-AttachVolumeTestJSON-936502140 Aug 30 01:08:04.579257 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-AttachVolumeTestJSON-936502140-project Aug 30 01:08:04.579257 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:08:04.579257 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:08:04.579257 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: c6fe0e0033de447da70be9bc0228eba2 Aug 30 01:08:04.579257 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-AttachVolumeTestJSON-936502140-project Aug 30 01:08:04.579257 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:08:04.579257 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Instance b59fedac-4fcb-47a8-8187-0a331d499fd2 could not be found. Aug 30 01:08:04.579257 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': 'b59fedac-4fcb-47a8-8187-0a331d499fd2'} Aug 30 01:08:04.580141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:08:04.580141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:08:04.580141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:08:04.580141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:08:04.580141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:08:04.580141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:08:04.580141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:08:04.580141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:08:04.580141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:08:04.580141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:08:04.580141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b59fedac-4fcb-47a8-8187-0a331d499fd2 could not be found. Aug 30 01:08:04.580141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:08:04.580141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:08:04.580141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:08:04.580141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:08:04.580141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:08:04.580141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:08:04.580141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:08:04.580141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:08:04.580141 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:08:04.581603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:08:04.581603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:08:04.581603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:08:04.581603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:08:04.581603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:08:04.581603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:08:04.581603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:08:04.581603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b59fedac-4fcb-47a8-8187-0a331d499fd2 could not be found. Aug 30 01:08:04.581603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:08:04.581603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:08:04.581603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:08:04.581603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:08:04.581603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:08:04.581603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:08:04.581603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:08:04.581603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:08:04.581603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b59fedac-4fcb-47a8-8187-0a331d499fd2 could not be found. Aug 30 01:08:04.581603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:08:04.582849 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-660aade2-6beb-428e-8a68-f3aa23ab8705 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] Returning 404 to user: Instance b59fedac-4fcb-47a8-8187-0a331d499fd2 could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:08:04.582943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-603779cf-c79d-458f-bee6-353b6507353a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:04.582943 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-603779cf-c79d-458f-bee6-353b6507353a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:04.583408 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-660aade2-6beb-428e-8a68-f3aa23ab8705 tempest-AttachVolumeTestJSON-936502140 tempest-AttachVolumeTestJSON-936502140-project] 10.222.0.78 "GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2" status: 404 len: 111 microversion: 2.1 time: 0.029376 Aug 30 01:08:04.583962 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-603779cf-c79d-458f-bee6-353b6507353a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:04.583962 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-603779cf-c79d-458f-bee6-353b6507353a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:04.583962 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-603779cf-c79d-458f-bee6-353b6507353a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:04.583962 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-603779cf-c79d-458f-bee6-353b6507353a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:04.584302 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 381/771] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:08:04 2022] GET /compute/v2.1/servers/b59fedac-4fcb-47a8-8187-0a331d499fd2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:08:04.713714 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-603779cf-c79d-458f-bee6-353b6507353a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:04.722533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-603779cf-c79d-458f-bee6-353b6507353a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:04.723988 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-603779cf-c79d-458f-bee6-353b6507353a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:04.725179 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-603779cf-c79d-458f-bee6-353b6507353a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1722 microversion: 2.20 time: 0.157481 Aug 30 01:08:04.725768 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 391/772] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:04 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:05.750191 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-1b903b19-f7f2-4058-84c2-4629b3d62dee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:05.751603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-1b903b19-f7f2-4058-84c2-4629b3d62dee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:05.769029 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1b903b19-f7f2-4058-84c2-4629b3d62dee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:05.769822 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1b903b19-f7f2-4058-84c2-4629b3d62dee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:05.771273 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1b903b19-f7f2-4058-84c2-4629b3d62dee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:05.772202 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1b903b19-f7f2-4058-84c2-4629b3d62dee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:05.772841 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1b903b19-f7f2-4058-84c2-4629b3d62dee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:05.773453 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1b903b19-f7f2-4058-84c2-4629b3d62dee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:05.956449 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-1b903b19-f7f2-4058-84c2-4629b3d62dee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:05.972138 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-1b903b19-f7f2-4058-84c2-4629b3d62dee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:05.974690 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-1b903b19-f7f2-4058-84c2-4629b3d62dee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:05.976831 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-1b903b19-f7f2-4058-84c2-4629b3d62dee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1722 microversion: 2.20 time: 0.232372 Aug 30 01:08:05.990343 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 382/773] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:05 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:07.003243 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-aa033687-9dd8-4ffa-bc38-e441f36fdad4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:07.004143 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-aa033687-9dd8-4ffa-bc38-e441f36fdad4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:07.010478 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aa033687-9dd8-4ffa-bc38-e441f36fdad4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:07.011054 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aa033687-9dd8-4ffa-bc38-e441f36fdad4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:07.011704 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aa033687-9dd8-4ffa-bc38-e441f36fdad4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:07.012462 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aa033687-9dd8-4ffa-bc38-e441f36fdad4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:07.012978 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aa033687-9dd8-4ffa-bc38-e441f36fdad4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:07.013612 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aa033687-9dd8-4ffa-bc38-e441f36fdad4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:07.225382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-aa033687-9dd8-4ffa-bc38-e441f36fdad4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:07.234447 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-aa033687-9dd8-4ffa-bc38-e441f36fdad4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:07.235896 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-aa033687-9dd8-4ffa-bc38-e441f36fdad4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:07.237327 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-aa033687-9dd8-4ffa-bc38-e441f36fdad4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1722 microversion: 2.20 time: 0.238168 Aug 30 01:08:07.238069 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 392/774] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:06 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:08.266344 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-6be1f778-f48c-4172-973a-84b923449f7a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:08.266960 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-6be1f778-f48c-4172-973a-84b923449f7a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:08.281709 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6be1f778-f48c-4172-973a-84b923449f7a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:08.282199 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6be1f778-f48c-4172-973a-84b923449f7a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:08.282638 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6be1f778-f48c-4172-973a-84b923449f7a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:08.283348 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6be1f778-f48c-4172-973a-84b923449f7a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:08.283801 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6be1f778-f48c-4172-973a-84b923449f7a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:08.284218 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6be1f778-f48c-4172-973a-84b923449f7a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:08.438473 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6be1f778-f48c-4172-973a-84b923449f7a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:08.447899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6be1f778-f48c-4172-973a-84b923449f7a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:08.449472 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6be1f778-f48c-4172-973a-84b923449f7a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:08.450687 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-6be1f778-f48c-4172-973a-84b923449f7a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1722 microversion: 2.20 time: 0.189474 Aug 30 01:08:08.451910 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 383/775] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:08 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:09.474286 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-ac4bf0c6-715b-4adc-8a03-a01aab014bcb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:09.474937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-ac4bf0c6-715b-4adc-8a03-a01aab014bcb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:09.482017 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ac4bf0c6-715b-4adc-8a03-a01aab014bcb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:09.482615 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ac4bf0c6-715b-4adc-8a03-a01aab014bcb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:09.483053 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ac4bf0c6-715b-4adc-8a03-a01aab014bcb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:09.483745 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ac4bf0c6-715b-4adc-8a03-a01aab014bcb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:09.484196 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ac4bf0c6-715b-4adc-8a03-a01aab014bcb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:09.484637 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ac4bf0c6-715b-4adc-8a03-a01aab014bcb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:09.620711 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-ac4bf0c6-715b-4adc-8a03-a01aab014bcb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:09.629902 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-ac4bf0c6-715b-4adc-8a03-a01aab014bcb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:09.631410 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-ac4bf0c6-715b-4adc-8a03-a01aab014bcb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:09.632506 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-ac4bf0c6-715b-4adc-8a03-a01aab014bcb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1722 microversion: 2.20 time: 0.162089 Aug 30 01:08:09.633167 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 393/776] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:09 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:10.656106 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-61cec6f0-8703-4014-845b-8ecf929ef438 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:10.656748 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-61cec6f0-8703-4014-845b-8ecf929ef438 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:10.666446 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-61cec6f0-8703-4014-845b-8ecf929ef438 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:10.666929 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-61cec6f0-8703-4014-845b-8ecf929ef438 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:10.667359 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-61cec6f0-8703-4014-845b-8ecf929ef438 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:10.668086 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-61cec6f0-8703-4014-845b-8ecf929ef438 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:10.668529 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-61cec6f0-8703-4014-845b-8ecf929ef438 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:10.668983 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-61cec6f0-8703-4014-845b-8ecf929ef438 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:10.805836 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-61cec6f0-8703-4014-845b-8ecf929ef438 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:10.815146 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-61cec6f0-8703-4014-845b-8ecf929ef438 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:10.816734 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-61cec6f0-8703-4014-845b-8ecf929ef438 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:10.818055 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-61cec6f0-8703-4014-845b-8ecf929ef438 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1722 microversion: 2.20 time: 0.166713 Aug 30 01:08:10.818728 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 384/777] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:10 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:11.842515 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-7248e55c-405b-4695-9132-f9868982ad7b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:11.843117 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-7248e55c-405b-4695-9132-f9868982ad7b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:11.849762 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7248e55c-405b-4695-9132-f9868982ad7b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:11.850243 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7248e55c-405b-4695-9132-f9868982ad7b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:11.850675 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7248e55c-405b-4695-9132-f9868982ad7b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:11.851365 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7248e55c-405b-4695-9132-f9868982ad7b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:11.851814 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7248e55c-405b-4695-9132-f9868982ad7b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:11.852297 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7248e55c-405b-4695-9132-f9868982ad7b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:11.989271 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7248e55c-405b-4695-9132-f9868982ad7b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:11.997351 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7248e55c-405b-4695-9132-f9868982ad7b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:11.999568 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7248e55c-405b-4695-9132-f9868982ad7b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:12.000730 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-7248e55c-405b-4695-9132-f9868982ad7b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1722 microversion: 2.20 time: 0.162139 Aug 30 01:08:12.001313 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 394/778] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:11 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:13.024024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-8bd2c930-7264-4394-be20-3f1537550646 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:13.024634 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-8bd2c930-7264-4394-be20-3f1537550646 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:13.032336 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8bd2c930-7264-4394-be20-3f1537550646 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:13.032819 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8bd2c930-7264-4394-be20-3f1537550646 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:13.033291 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8bd2c930-7264-4394-be20-3f1537550646 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:13.033985 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8bd2c930-7264-4394-be20-3f1537550646 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:13.034435 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8bd2c930-7264-4394-be20-3f1537550646 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:13.034865 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8bd2c930-7264-4394-be20-3f1537550646 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:13.162105 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-8bd2c930-7264-4394-be20-3f1537550646 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:13.170918 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-8bd2c930-7264-4394-be20-3f1537550646 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:13.172381 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-8bd2c930-7264-4394-be20-3f1537550646 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:13.173565 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-8bd2c930-7264-4394-be20-3f1537550646 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1722 microversion: 2.20 time: 0.153596 Aug 30 01:08:13.174119 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 385/779] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:13 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:14.196173 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-7e5a1ee3-08c6-4207-a48b-7ac285042963 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:14.196677 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-7e5a1ee3-08c6-4207-a48b-7ac285042963 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:14.204586 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7e5a1ee3-08c6-4207-a48b-7ac285042963 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:14.205223 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7e5a1ee3-08c6-4207-a48b-7ac285042963 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:14.205722 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7e5a1ee3-08c6-4207-a48b-7ac285042963 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:14.206473 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7e5a1ee3-08c6-4207-a48b-7ac285042963 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:14.207223 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7e5a1ee3-08c6-4207-a48b-7ac285042963 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:14.207733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7e5a1ee3-08c6-4207-a48b-7ac285042963 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:14.356730 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7e5a1ee3-08c6-4207-a48b-7ac285042963 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:14.365411 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7e5a1ee3-08c6-4207-a48b-7ac285042963 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:14.366842 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7e5a1ee3-08c6-4207-a48b-7ac285042963 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:14.368052 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-7e5a1ee3-08c6-4207-a48b-7ac285042963 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1722 microversion: 2.20 time: 0.176078 Aug 30 01:08:14.368602 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 395/780] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:14 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:15.390403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-37901c2e-ef59-4a9e-a9a3-41b6406557a7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:15.391092 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-37901c2e-ef59-4a9e-a9a3-41b6406557a7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:15.398376 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-37901c2e-ef59-4a9e-a9a3-41b6406557a7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:15.398852 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-37901c2e-ef59-4a9e-a9a3-41b6406557a7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:15.399285 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-37901c2e-ef59-4a9e-a9a3-41b6406557a7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:15.399974 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-37901c2e-ef59-4a9e-a9a3-41b6406557a7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:15.400419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-37901c2e-ef59-4a9e-a9a3-41b6406557a7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:15.400837 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-37901c2e-ef59-4a9e-a9a3-41b6406557a7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:15.533830 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-37901c2e-ef59-4a9e-a9a3-41b6406557a7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:15.541742 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-37901c2e-ef59-4a9e-a9a3-41b6406557a7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:15.543185 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-37901c2e-ef59-4a9e-a9a3-41b6406557a7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:15.544338 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-37901c2e-ef59-4a9e-a9a3-41b6406557a7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1722 microversion: 2.20 time: 0.157904 Aug 30 01:08:15.545677 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 386/781] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:15 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:08:16.569948 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-c990515c-52a2-482b-9e4c-10e5ec98079a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:16.570552 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-c990515c-52a2-482b-9e4c-10e5ec98079a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:16.579336 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c990515c-52a2-482b-9e4c-10e5ec98079a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:16.579825 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c990515c-52a2-482b-9e4c-10e5ec98079a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:16.580353 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c990515c-52a2-482b-9e4c-10e5ec98079a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:16.581111 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c990515c-52a2-482b-9e4c-10e5ec98079a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:16.581556 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c990515c-52a2-482b-9e4c-10e5ec98079a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:16.581982 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c990515c-52a2-482b-9e4c-10e5ec98079a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:16.763711 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-c990515c-52a2-482b-9e4c-10e5ec98079a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:16.772313 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-c990515c-52a2-482b-9e4c-10e5ec98079a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:16.774226 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-c990515c-52a2-482b-9e4c-10e5ec98079a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:16.775964 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-c990515c-52a2-482b-9e4c-10e5ec98079a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1722 microversion: 2.20 time: 0.209617 Aug 30 01:08:16.776897 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 396/782] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:16 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:17.803982 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-83d42dc0-de27-4bb0-88df-74e2eff9da7e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:17.804598 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-83d42dc0-de27-4bb0-88df-74e2eff9da7e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:17.811859 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-83d42dc0-de27-4bb0-88df-74e2eff9da7e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:17.812328 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-83d42dc0-de27-4bb0-88df-74e2eff9da7e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:17.812794 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-83d42dc0-de27-4bb0-88df-74e2eff9da7e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:17.813526 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-83d42dc0-de27-4bb0-88df-74e2eff9da7e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:17.814020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-83d42dc0-de27-4bb0-88df-74e2eff9da7e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:17.814451 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-83d42dc0-de27-4bb0-88df-74e2eff9da7e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:17.956948 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-83d42dc0-de27-4bb0-88df-74e2eff9da7e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:17.965434 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-83d42dc0-de27-4bb0-88df-74e2eff9da7e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:17.967423 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-83d42dc0-de27-4bb0-88df-74e2eff9da7e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:17.968589 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-83d42dc0-de27-4bb0-88df-74e2eff9da7e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1722 microversion: 2.20 time: 0.168601 Aug 30 01:08:17.969375 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 387/783] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:17 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:18.993560 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-3fc0254d-dd8a-4d8c-bbc2-b63a9185a29d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:18.993560 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-3fc0254d-dd8a-4d8c-bbc2-b63a9185a29d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:18.998647 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3fc0254d-dd8a-4d8c-bbc2-b63a9185a29d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:18.999625 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3fc0254d-dd8a-4d8c-bbc2-b63a9185a29d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:19.000067 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3fc0254d-dd8a-4d8c-bbc2-b63a9185a29d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:19.000744 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3fc0254d-dd8a-4d8c-bbc2-b63a9185a29d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:19.002459 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3fc0254d-dd8a-4d8c-bbc2-b63a9185a29d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:19.002459 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3fc0254d-dd8a-4d8c-bbc2-b63a9185a29d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:19.148512 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-3fc0254d-dd8a-4d8c-bbc2-b63a9185a29d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:19.157738 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-3fc0254d-dd8a-4d8c-bbc2-b63a9185a29d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:19.159279 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-3fc0254d-dd8a-4d8c-bbc2-b63a9185a29d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:19.160806 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-3fc0254d-dd8a-4d8c-bbc2-b63a9185a29d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1743 microversion: 2.20 time: 0.173284 Aug 30 01:08:19.161567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 397/784] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:18 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:20.186021 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-84a30505-aea0-481d-8d18-025d8a3f1aee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:20.187266 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-84a30505-aea0-481d-8d18-025d8a3f1aee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:20.194077 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-84a30505-aea0-481d-8d18-025d8a3f1aee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:20.194567 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-84a30505-aea0-481d-8d18-025d8a3f1aee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:20.195001 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-84a30505-aea0-481d-8d18-025d8a3f1aee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:20.195697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-84a30505-aea0-481d-8d18-025d8a3f1aee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:20.196315 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-84a30505-aea0-481d-8d18-025d8a3f1aee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:20.196937 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-84a30505-aea0-481d-8d18-025d8a3f1aee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:20.216124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:20.376630 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-84a30505-aea0-481d-8d18-025d8a3f1aee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:20.385661 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-84a30505-aea0-481d-8d18-025d8a3f1aee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:20.387042 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-84a30505-aea0-481d-8d18-025d8a3f1aee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:20.389120 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-84a30505-aea0-481d-8d18-025d8a3f1aee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1743 microversion: 2.20 time: 0.207113 Aug 30 01:08:20.390828 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 388/785] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:20 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1743 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:21.417176 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-36cc489a-2dc4-424f-83f7-1c797e971f87 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:21.418469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-36cc489a-2dc4-424f-83f7-1c797e971f87 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:21.429333 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-36cc489a-2dc4-424f-83f7-1c797e971f87 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:21.430059 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-36cc489a-2dc4-424f-83f7-1c797e971f87 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:21.430591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-36cc489a-2dc4-424f-83f7-1c797e971f87 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:21.431517 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-36cc489a-2dc4-424f-83f7-1c797e971f87 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:21.432179 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-36cc489a-2dc4-424f-83f7-1c797e971f87 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:21.432831 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-36cc489a-2dc4-424f-83f7-1c797e971f87 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:21.454596 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:21.599564 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-36cc489a-2dc4-424f-83f7-1c797e971f87 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:21.614804 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-36cc489a-2dc4-424f-83f7-1c797e971f87 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:21.624359 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-36cc489a-2dc4-424f-83f7-1c797e971f87 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:21.625623 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-36cc489a-2dc4-424f-83f7-1c797e971f87 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1738 microversion: 2.20 time: 0.212361 Aug 30 01:08:21.626221 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 398/786] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:21 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:22.423408 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-653328e0-68ad-44c9-9abe-d6235e3f0ea3 req-20a72acc-1b22-49d7-9aa6-27f58d346ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9b5386-7fbc-4d22-a388-55c656bf9255", "name": "network-vif-plugged", "status": "completed", "tag": "f87d3a77-05ed-43ac-b192-82ed7d858c40"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:08:22.448374 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-653328e0-68ad-44c9-9abe-d6235e3f0ea3 req-20a72acc-1b22-49d7-9aa6-27f58d346ce3 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:22.448883 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-653328e0-68ad-44c9-9abe-d6235e3f0ea3 req-20a72acc-1b22-49d7-9aa6-27f58d346ce3 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:22.449459 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-653328e0-68ad-44c9-9abe-d6235e3f0ea3 req-20a72acc-1b22-49d7-9aa6-27f58d346ce3 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:22.476565 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-653328e0-68ad-44c9-9abe-d6235e3f0ea3 req-20a72acc-1b22-49d7-9aa6-27f58d346ce3 service nova] Creating event network-vif-plugged:f87d3a77-05ed-43ac-b192-82ed7d858c40 for instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 on hv-cinder-81514 Aug 30 01:08:22.484374 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-653328e0-68ad-44c9-9abe-d6235e3f0ea3 req-20a72acc-1b22-49d7-9aa6-27f58d346ce3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064602 Aug 30 01:08:22.486890 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 389/787] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:08:22.650488 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-1f8aef78-74cb-491b-a5ca-f7261c1feec2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:22.651942 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-1f8aef78-74cb-491b-a5ca-f7261c1feec2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:22.662786 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1f8aef78-74cb-491b-a5ca-f7261c1feec2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:22.664138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1f8aef78-74cb-491b-a5ca-f7261c1feec2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:22.664802 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1f8aef78-74cb-491b-a5ca-f7261c1feec2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:22.665778 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1f8aef78-74cb-491b-a5ca-f7261c1feec2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:22.666896 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1f8aef78-74cb-491b-a5ca-f7261c1feec2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:22.667545 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1f8aef78-74cb-491b-a5ca-f7261c1feec2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:22.856037 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-1f8aef78-74cb-491b-a5ca-f7261c1feec2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:22.867491 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-1f8aef78-74cb-491b-a5ca-f7261c1feec2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:22.868872 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-1f8aef78-74cb-491b-a5ca-f7261c1feec2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:22.870128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-1f8aef78-74cb-491b-a5ca-f7261c1feec2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1738 microversion: 2.20 time: 0.223863 Aug 30 01:08:22.870901 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 399/788] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:22 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:08:23.901098 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-287b7101-bfe1-470d-8a68-5193aaa3debe tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:23.902559 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-287b7101-bfe1-470d-8a68-5193aaa3debe tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:23.910295 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-287b7101-bfe1-470d-8a68-5193aaa3debe tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:23.910988 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-287b7101-bfe1-470d-8a68-5193aaa3debe tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:23.911608 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-287b7101-bfe1-470d-8a68-5193aaa3debe tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:23.913914 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-287b7101-bfe1-470d-8a68-5193aaa3debe tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:23.914950 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-287b7101-bfe1-470d-8a68-5193aaa3debe tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:23.916015 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-287b7101-bfe1-470d-8a68-5193aaa3debe tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:24.080208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-287b7101-bfe1-470d-8a68-5193aaa3debe tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:24.089537 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-287b7101-bfe1-470d-8a68-5193aaa3debe tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:24.091940 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-287b7101-bfe1-470d-8a68-5193aaa3debe tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:24.093411 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-287b7101-bfe1-470d-8a68-5193aaa3debe tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1738 microversion: 2.20 time: 0.197426 Aug 30 01:08:24.094068 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 390/789] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:23 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:25.117951 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8ea95aaa-de35-45d5-8ca1-2c0552482e26 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:25.118847 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8ea95aaa-de35-45d5-8ca1-2c0552482e26 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:25.126183 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ea95aaa-de35-45d5-8ca1-2c0552482e26 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:25.126927 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ea95aaa-de35-45d5-8ca1-2c0552482e26 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:25.127592 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ea95aaa-de35-45d5-8ca1-2c0552482e26 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:25.128688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ea95aaa-de35-45d5-8ca1-2c0552482e26 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:25.129369 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ea95aaa-de35-45d5-8ca1-2c0552482e26 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:25.129953 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8ea95aaa-de35-45d5-8ca1-2c0552482e26 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:25.280265 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8ea95aaa-de35-45d5-8ca1-2c0552482e26 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:25.288450 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8ea95aaa-de35-45d5-8ca1-2c0552482e26 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:25.289930 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8ea95aaa-de35-45d5-8ca1-2c0552482e26 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:25.291095 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8ea95aaa-de35-45d5-8ca1-2c0552482e26 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1738 microversion: 2.20 time: 0.177640 Aug 30 01:08:25.291816 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 400/790] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:25 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:26.318645 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0cb8a622-7e57-49bf-a938-29fe676717e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:26.319245 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-0cb8a622-7e57-49bf-a938-29fe676717e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:26.328801 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0cb8a622-7e57-49bf-a938-29fe676717e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:26.332412 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0cb8a622-7e57-49bf-a938-29fe676717e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:26.332899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0cb8a622-7e57-49bf-a938-29fe676717e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:26.333904 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0cb8a622-7e57-49bf-a938-29fe676717e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:26.334546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0cb8a622-7e57-49bf-a938-29fe676717e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:26.335381 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0cb8a622-7e57-49bf-a938-29fe676717e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:26.517268 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-0cb8a622-7e57-49bf-a938-29fe676717e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:26.526045 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-0cb8a622-7e57-49bf-a938-29fe676717e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:26.527501 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-0cb8a622-7e57-49bf-a938-29fe676717e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:26.533697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0cb8a622-7e57-49bf-a938-29fe676717e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1738 microversion: 2.20 time: 0.215636 Aug 30 01:08:26.533697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 391/791] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:26 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:27.553385 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-5ddc37a9-7565-4362-ac89-c352ed23f68a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:27.553980 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-5ddc37a9-7565-4362-ac89-c352ed23f68a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:27.561393 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5ddc37a9-7565-4362-ac89-c352ed23f68a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:27.562094 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5ddc37a9-7565-4362-ac89-c352ed23f68a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:27.562646 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5ddc37a9-7565-4362-ac89-c352ed23f68a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:27.563477 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5ddc37a9-7565-4362-ac89-c352ed23f68a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:27.564040 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5ddc37a9-7565-4362-ac89-c352ed23f68a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:27.564576 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5ddc37a9-7565-4362-ac89-c352ed23f68a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:27.726612 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-5ddc37a9-7565-4362-ac89-c352ed23f68a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:27.741959 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-5ddc37a9-7565-4362-ac89-c352ed23f68a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:27.743925 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-5ddc37a9-7565-4362-ac89-c352ed23f68a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:27.745364 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-5ddc37a9-7565-4362-ac89-c352ed23f68a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1738 microversion: 2.20 time: 0.195848 Aug 30 01:08:27.746242 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 401/792] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:27 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:28.772122 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-6c768325-3834-44f3-9678-003c3c2520f1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:28.773623 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-6c768325-3834-44f3-9678-003c3c2520f1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:28.776429 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:28.783209 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6c768325-3834-44f3-9678-003c3c2520f1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:28.783819 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6c768325-3834-44f3-9678-003c3c2520f1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:28.784507 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6c768325-3834-44f3-9678-003c3c2520f1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:28.785673 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6c768325-3834-44f3-9678-003c3c2520f1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:28.786331 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6c768325-3834-44f3-9678-003c3c2520f1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:28.787096 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6c768325-3834-44f3-9678-003c3c2520f1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:28.952418 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6c768325-3834-44f3-9678-003c3c2520f1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:28.964206 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6c768325-3834-44f3-9678-003c3c2520f1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:28.965686 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6c768325-3834-44f3-9678-003c3c2520f1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:28.971760 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-6c768325-3834-44f3-9678-003c3c2520f1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1738 microversion: 2.20 time: 0.206190 Aug 30 01:08:28.972755 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 392/793] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:28 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:29.999732 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-5f51dfd8-6faa-4602-a54a-d8dd8e201a41 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:30.001259 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-5f51dfd8-6faa-4602-a54a-d8dd8e201a41 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:30.008077 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=36 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:30.010971 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5f51dfd8-6faa-4602-a54a-d8dd8e201a41 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:30.011837 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5f51dfd8-6faa-4602-a54a-d8dd8e201a41 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:30.013530 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5f51dfd8-6faa-4602-a54a-d8dd8e201a41 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:30.014980 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5f51dfd8-6faa-4602-a54a-d8dd8e201a41 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:30.015686 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5f51dfd8-6faa-4602-a54a-d8dd8e201a41 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:30.016792 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5f51dfd8-6faa-4602-a54a-d8dd8e201a41 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:30.237291 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-5f51dfd8-6faa-4602-a54a-d8dd8e201a41 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:30.249436 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-5f51dfd8-6faa-4602-a54a-d8dd8e201a41 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:30.251313 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-5f51dfd8-6faa-4602-a54a-d8dd8e201a41 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:30.252595 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-5f51dfd8-6faa-4602-a54a-d8dd8e201a41 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1738 microversion: 2.20 time: 0.260569 Aug 30 01:08:30.260851 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 402/794] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:29 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1738 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:31.285248 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-7f450b6f-771a-4db8-ac2d-be3344fdc0d4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:31.285248 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-7f450b6f-771a-4db8-ac2d-be3344fdc0d4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:31.292935 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7f450b6f-771a-4db8-ac2d-be3344fdc0d4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:31.293460 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7f450b6f-771a-4db8-ac2d-be3344fdc0d4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:31.293969 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7f450b6f-771a-4db8-ac2d-be3344fdc0d4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:31.294688 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7f450b6f-771a-4db8-ac2d-be3344fdc0d4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:31.295139 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7f450b6f-771a-4db8-ac2d-be3344fdc0d4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:31.295733 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7f450b6f-771a-4db8-ac2d-be3344fdc0d4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:31.466395 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-7f450b6f-771a-4db8-ac2d-be3344fdc0d4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:31.475333 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-7f450b6f-771a-4db8-ac2d-be3344fdc0d4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:31.476845 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-7f450b6f-771a-4db8-ac2d-be3344fdc0d4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:31.478051 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-7f450b6f-771a-4db8-ac2d-be3344fdc0d4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1738 microversion: 2.20 time: 0.197955 Aug 30 01:08:31.478612 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 393/795] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:31 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:32.503377 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-90fe3cb6-7305-4db4-98ae-7fe8be5af032 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:32.504615 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-90fe3cb6-7305-4db4-98ae-7fe8be5af032 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:32.512330 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-90fe3cb6-7305-4db4-98ae-7fe8be5af032 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:32.514090 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-90fe3cb6-7305-4db4-98ae-7fe8be5af032 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:32.514574 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-90fe3cb6-7305-4db4-98ae-7fe8be5af032 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:32.515287 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-90fe3cb6-7305-4db4-98ae-7fe8be5af032 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:32.515744 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-90fe3cb6-7305-4db4-98ae-7fe8be5af032 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:32.516167 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-90fe3cb6-7305-4db4-98ae-7fe8be5af032 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:32.678073 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-90fe3cb6-7305-4db4-98ae-7fe8be5af032 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:32.686358 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-90fe3cb6-7305-4db4-98ae-7fe8be5af032 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:32.688008 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-90fe3cb6-7305-4db4-98ae-7fe8be5af032 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:32.689294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-90fe3cb6-7305-4db4-98ae-7fe8be5af032 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1720 microversion: 2.20 time: 0.190580 Aug 30 01:08:32.689835 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 403/796] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:32 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1720 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:33.713422 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-27e430af-7113-4d5c-8586-4b902014e9bb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:33.714657 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-27e430af-7113-4d5c-8586-4b902014e9bb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:33.730967 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-27e430af-7113-4d5c-8586-4b902014e9bb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:33.731990 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-27e430af-7113-4d5c-8586-4b902014e9bb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:33.732455 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-27e430af-7113-4d5c-8586-4b902014e9bb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:33.733183 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-27e430af-7113-4d5c-8586-4b902014e9bb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:33.733664 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-27e430af-7113-4d5c-8586-4b902014e9bb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:33.734056 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-27e430af-7113-4d5c-8586-4b902014e9bb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:33.869362 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-27e430af-7113-4d5c-8586-4b902014e9bb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:33.878473 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-27e430af-7113-4d5c-8586-4b902014e9bb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:33.879913 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-27e430af-7113-4d5c-8586-4b902014e9bb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:33.881067 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-27e430af-7113-4d5c-8586-4b902014e9bb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1720 microversion: 2.20 time: 0.171970 Aug 30 01:08:33.881661 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 394/797] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:33 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:34.904840 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-85657f79-8656-4356-aaee-130fb98da918 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:34.905505 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-85657f79-8656-4356-aaee-130fb98da918 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:34.917473 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-85657f79-8656-4356-aaee-130fb98da918 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:34.917473 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-85657f79-8656-4356-aaee-130fb98da918 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:34.917473 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-85657f79-8656-4356-aaee-130fb98da918 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:34.917870 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-85657f79-8656-4356-aaee-130fb98da918 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:34.918162 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-85657f79-8656-4356-aaee-130fb98da918 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:34.918632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-85657f79-8656-4356-aaee-130fb98da918 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:35.102040 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-85657f79-8656-4356-aaee-130fb98da918 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:35.111284 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-85657f79-8656-4356-aaee-130fb98da918 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:35.112832 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-85657f79-8656-4356-aaee-130fb98da918 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:35.114132 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-85657f79-8656-4356-aaee-130fb98da918 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1720 microversion: 2.20 time: 0.214113 Aug 30 01:08:35.114990 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 404/798] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:34 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1720 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:36.138490 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3bc64cf6-401d-4655-ab53-4deb45772d7f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:36.139560 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-3bc64cf6-401d-4655-ab53-4deb45772d7f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:36.156623 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3bc64cf6-401d-4655-ab53-4deb45772d7f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:36.157150 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3bc64cf6-401d-4655-ab53-4deb45772d7f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:36.157592 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3bc64cf6-401d-4655-ab53-4deb45772d7f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:36.158435 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3bc64cf6-401d-4655-ab53-4deb45772d7f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:36.173214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3bc64cf6-401d-4655-ab53-4deb45772d7f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:36.173214 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3bc64cf6-401d-4655-ab53-4deb45772d7f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:36.365138 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3bc64cf6-401d-4655-ab53-4deb45772d7f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:36.375260 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3bc64cf6-401d-4655-ab53-4deb45772d7f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:36.377697 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3bc64cf6-401d-4655-ab53-4deb45772d7f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:36.379600 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3bc64cf6-401d-4655-ab53-4deb45772d7f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1663 microversion: 2.20 time: 0.246171 Aug 30 01:08:36.382014 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 395/799] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:36 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1663 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:36.405164 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-ddfa4b68-1e8b-4db7-9c2f-51c04eea8af2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fd12643-9b86-4291-942c-418d93182c04"}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:08:36.408405 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-ddfa4b68-1e8b-4db7-9c2f-51c04eea8af2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:36.416367 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ddfa4b68-1e8b-4db7-9c2f-51c04eea8af2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:36.417057 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ddfa4b68-1e8b-4db7-9c2f-51c04eea8af2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:36.417711 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ddfa4b68-1e8b-4db7-9c2f-51c04eea8af2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:36.418622 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ddfa4b68-1e8b-4db7-9c2f-51c04eea8af2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:36.419985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ddfa4b68-1e8b-4db7-9c2f-51c04eea8af2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:36.420579 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ddfa4b68-1e8b-4db7-9c2f-51c04eea8af2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:36.435641 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-d8eff0ec-801e-46fc-b8fe-5ccae765a7ce req-71f4236b-ecc6-49f8-995c-c6490581c624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9b5386-7fbc-4d22-a388-55c656bf9255", "name": "network-vif-unplugged", "status": "completed", "tag": "f87d3a77-05ed-43ac-b192-82ed7d858c40"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:08:36.459668 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-d8eff0ec-801e-46fc-b8fe-5ccae765a7ce req-71f4236b-ecc6-49f8-995c-c6490581c624 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:36.460314 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-d8eff0ec-801e-46fc-b8fe-5ccae765a7ce req-71f4236b-ecc6-49f8-995c-c6490581c624 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:36.461676 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-d8eff0ec-801e-46fc-b8fe-5ccae765a7ce req-71f4236b-ecc6-49f8-995c-c6490581c624 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:36.492670 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.compute.server_external_events [req-d8eff0ec-801e-46fc-b8fe-5ccae765a7ce req-71f4236b-ecc6-49f8-995c-c6490581c624 service nova] Unable to find a host for instance 8f9b5386-7fbc-4d22-a388-55c656bf9255. Dropping event network-vif-unplugged {{(pid=120631) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 01:08:36.497947 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-d8eff0ec-801e-46fc-b8fe-5ccae765a7ce req-71f4236b-ecc6-49f8-995c-c6490581c624 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.069284 Aug 30 01:08:36.503663 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 396/800] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 76 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 30 01:08:36.743837 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-ddfa4b68-1e8b-4db7-9c2f-51c04eea8af2 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "POST /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.344422 Aug 30 01:08:36.744445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 405/801] 10.222.0.78 () {62 vars in 1364 bytes} [Tue Aug 30 01:08:36 2022] POST /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255/os-volume_attachments => generated 188 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:08:36.874276 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-793a8748-b386-47d8-9c63-7d52a89fdc7a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:08:36.874872 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-793a8748-b386-47d8-9c63-7d52a89fdc7a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:36.880865 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-793a8748-b386-47d8-9c63-7d52a89fdc7a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:36.881347 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-793a8748-b386-47d8-9c63-7d52a89fdc7a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:36.881787 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-793a8748-b386-47d8-9c63-7d52a89fdc7a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:36.882485 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-793a8748-b386-47d8-9c63-7d52a89fdc7a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:36.882938 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-793a8748-b386-47d8-9c63-7d52a89fdc7a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:36.883362 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-793a8748-b386-47d8-9c63-7d52a89fdc7a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:36.926560 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-793a8748-b386-47d8-9c63-7d52a89fdc7a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120631) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 01:08:36.992357 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-793a8748-b386-47d8-9c63-7d52a89fdc7a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "POST /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255/action" status: 202 len: 0 microversion: 2.20 time: 0.122533 Aug 30 01:08:36.992969 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 397/802] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Aug 30 01:08:36 2022] POST /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:08:37.001934 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-0cbc0147-57b2-45d4-b9b0-eda4e5cf84c1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:37.002568 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-0cbc0147-57b2-45d4-b9b0-eda4e5cf84c1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:37.009146 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0cbc0147-57b2-45d4-b9b0-eda4e5cf84c1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:37.009642 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0cbc0147-57b2-45d4-b9b0-eda4e5cf84c1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:37.010085 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0cbc0147-57b2-45d4-b9b0-eda4e5cf84c1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:37.010782 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0cbc0147-57b2-45d4-b9b0-eda4e5cf84c1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:37.011237 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0cbc0147-57b2-45d4-b9b0-eda4e5cf84c1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:37.011665 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0cbc0147-57b2-45d4-b9b0-eda4e5cf84c1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:37.144440 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-0cbc0147-57b2-45d4-b9b0-eda4e5cf84c1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:37.153872 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-0cbc0147-57b2-45d4-b9b0-eda4e5cf84c1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:37.155592 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-0cbc0147-57b2-45d4-b9b0-eda4e5cf84c1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:37.156764 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-0cbc0147-57b2-45d4-b9b0-eda4e5cf84c1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1749 microversion: 2.20 time: 0.158930 Aug 30 01:08:37.157354 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 406/803] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:36 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:38.179895 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-84248be6-fe74-449c-b5af-692a9d2ecf6f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:38.180501 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-84248be6-fe74-449c-b5af-692a9d2ecf6f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:38.187515 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-84248be6-fe74-449c-b5af-692a9d2ecf6f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:38.187996 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-84248be6-fe74-449c-b5af-692a9d2ecf6f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:38.188431 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-84248be6-fe74-449c-b5af-692a9d2ecf6f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:38.189147 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-84248be6-fe74-449c-b5af-692a9d2ecf6f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:38.189603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-84248be6-fe74-449c-b5af-692a9d2ecf6f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:38.190022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-84248be6-fe74-449c-b5af-692a9d2ecf6f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:38.321514 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-84248be6-fe74-449c-b5af-692a9d2ecf6f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:38.329995 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-84248be6-fe74-449c-b5af-692a9d2ecf6f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:38.331435 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-84248be6-fe74-449c-b5af-692a9d2ecf6f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:38.332583 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-84248be6-fe74-449c-b5af-692a9d2ecf6f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1751 microversion: 2.20 time: 0.157070 Aug 30 01:08:38.333163 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 398/804] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:38 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:39.355865 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-72d81578-0406-4ca1-a746-2a3b82f0ab90 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:39.357330 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-72d81578-0406-4ca1-a746-2a3b82f0ab90 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:39.364167 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-72d81578-0406-4ca1-a746-2a3b82f0ab90 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:39.364659 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-72d81578-0406-4ca1-a746-2a3b82f0ab90 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:39.365129 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-72d81578-0406-4ca1-a746-2a3b82f0ab90 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:39.365841 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-72d81578-0406-4ca1-a746-2a3b82f0ab90 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:39.366301 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-72d81578-0406-4ca1-a746-2a3b82f0ab90 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:39.366733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-72d81578-0406-4ca1-a746-2a3b82f0ab90 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:39.508793 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-72d81578-0406-4ca1-a746-2a3b82f0ab90 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:39.518068 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-72d81578-0406-4ca1-a746-2a3b82f0ab90 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:39.519539 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-72d81578-0406-4ca1-a746-2a3b82f0ab90 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:39.520816 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-72d81578-0406-4ca1-a746-2a3b82f0ab90 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1751 microversion: 2.20 time: 0.168772 Aug 30 01:08:39.521403 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 407/805] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:39 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:40.544858 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-36d53f65-876c-4e38-86b4-c04bf1919cc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:40.545403 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-36d53f65-876c-4e38-86b4-c04bf1919cc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:40.551879 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-36d53f65-876c-4e38-86b4-c04bf1919cc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:40.552436 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-36d53f65-876c-4e38-86b4-c04bf1919cc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:40.552867 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-36d53f65-876c-4e38-86b4-c04bf1919cc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:40.553612 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-36d53f65-876c-4e38-86b4-c04bf1919cc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:40.554067 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-36d53f65-876c-4e38-86b4-c04bf1919cc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:40.554483 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-36d53f65-876c-4e38-86b4-c04bf1919cc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:40.705207 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-36d53f65-876c-4e38-86b4-c04bf1919cc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:40.715079 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-36d53f65-876c-4e38-86b4-c04bf1919cc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:40.715950 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-36d53f65-876c-4e38-86b4-c04bf1919cc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:40.717154 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-36d53f65-876c-4e38-86b4-c04bf1919cc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1751 microversion: 2.20 time: 0.176312 Aug 30 01:08:40.717694 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 399/806] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:40 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:41.740723 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-0a3d03d0-d4bd-4c23-892a-b22600569131 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:41.741355 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-0a3d03d0-d4bd-4c23-892a-b22600569131 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:41.748259 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0a3d03d0-d4bd-4c23-892a-b22600569131 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:41.748742 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0a3d03d0-d4bd-4c23-892a-b22600569131 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:41.749212 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0a3d03d0-d4bd-4c23-892a-b22600569131 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:41.749895 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0a3d03d0-d4bd-4c23-892a-b22600569131 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:41.750349 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0a3d03d0-d4bd-4c23-892a-b22600569131 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:41.750773 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0a3d03d0-d4bd-4c23-892a-b22600569131 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:41.884462 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-0a3d03d0-d4bd-4c23-892a-b22600569131 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:41.893960 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-0a3d03d0-d4bd-4c23-892a-b22600569131 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:41.895402 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-0a3d03d0-d4bd-4c23-892a-b22600569131 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:41.896571 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-0a3d03d0-d4bd-4c23-892a-b22600569131 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1807 microversion: 2.20 time: 0.159770 Aug 30 01:08:41.897157 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 408/807] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:41 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:42.920142 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e0eaea0b-1cfe-4b09-9d5b-fd81503fd435 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:42.920762 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e0eaea0b-1cfe-4b09-9d5b-fd81503fd435 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:42.927145 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e0eaea0b-1cfe-4b09-9d5b-fd81503fd435 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:42.927624 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e0eaea0b-1cfe-4b09-9d5b-fd81503fd435 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:42.928055 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e0eaea0b-1cfe-4b09-9d5b-fd81503fd435 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:42.928743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e0eaea0b-1cfe-4b09-9d5b-fd81503fd435 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:42.929237 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e0eaea0b-1cfe-4b09-9d5b-fd81503fd435 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:42.929680 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e0eaea0b-1cfe-4b09-9d5b-fd81503fd435 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:43.059163 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e0eaea0b-1cfe-4b09-9d5b-fd81503fd435 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:43.068248 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e0eaea0b-1cfe-4b09-9d5b-fd81503fd435 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:43.069708 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e0eaea0b-1cfe-4b09-9d5b-fd81503fd435 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:43.070858 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e0eaea0b-1cfe-4b09-9d5b-fd81503fd435 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1807 microversion: 2.20 time: 0.155342 Aug 30 01:08:43.071406 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 400/808] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:42 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:44.094034 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-6022dd9f-5610-41aa-b27c-0fd620606569 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:44.094670 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-6022dd9f-5610-41aa-b27c-0fd620606569 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:44.102246 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6022dd9f-5610-41aa-b27c-0fd620606569 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:44.103132 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6022dd9f-5610-41aa-b27c-0fd620606569 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:44.103438 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6022dd9f-5610-41aa-b27c-0fd620606569 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:44.104314 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6022dd9f-5610-41aa-b27c-0fd620606569 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:44.104745 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6022dd9f-5610-41aa-b27c-0fd620606569 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:44.105274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6022dd9f-5610-41aa-b27c-0fd620606569 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:44.274483 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-6022dd9f-5610-41aa-b27c-0fd620606569 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:44.283916 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-6022dd9f-5610-41aa-b27c-0fd620606569 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:44.285459 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-6022dd9f-5610-41aa-b27c-0fd620606569 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:44.286746 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-6022dd9f-5610-41aa-b27c-0fd620606569 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1807 microversion: 2.20 time: 0.197424 Aug 30 01:08:44.287375 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 409/809] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:44 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:45.310417 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-00c903f2-eae4-4dfd-baa6-72690b026f62 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:45.311239 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-00c903f2-eae4-4dfd-baa6-72690b026f62 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:45.337680 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-00c903f2-eae4-4dfd-baa6-72690b026f62 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:45.339140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-00c903f2-eae4-4dfd-baa6-72690b026f62 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:45.339847 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-00c903f2-eae4-4dfd-baa6-72690b026f62 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:45.347600 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-00c903f2-eae4-4dfd-baa6-72690b026f62 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:45.348347 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-00c903f2-eae4-4dfd-baa6-72690b026f62 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:45.351282 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-00c903f2-eae4-4dfd-baa6-72690b026f62 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:45.639418 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-00c903f2-eae4-4dfd-baa6-72690b026f62 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:45.655109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-00c903f2-eae4-4dfd-baa6-72690b026f62 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:45.662093 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-00c903f2-eae4-4dfd-baa6-72690b026f62 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:45.666573 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-00c903f2-eae4-4dfd-baa6-72690b026f62 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1807 microversion: 2.20 time: 0.360023 Aug 30 01:08:45.670855 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 401/810] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:45 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1807 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:46.691966 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f852543d-93ae-41d3-8a0e-f1c6a3c0b038 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:46.693330 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-f852543d-93ae-41d3-8a0e-f1c6a3c0b038 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:46.699985 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f852543d-93ae-41d3-8a0e-f1c6a3c0b038 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:46.700487 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f852543d-93ae-41d3-8a0e-f1c6a3c0b038 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:46.701255 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f852543d-93ae-41d3-8a0e-f1c6a3c0b038 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:46.701972 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f852543d-93ae-41d3-8a0e-f1c6a3c0b038 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:46.702430 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f852543d-93ae-41d3-8a0e-f1c6a3c0b038 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:46.703017 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f852543d-93ae-41d3-8a0e-f1c6a3c0b038 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:46.999870 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-f852543d-93ae-41d3-8a0e-f1c6a3c0b038 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:47.009873 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-f852543d-93ae-41d3-8a0e-f1c6a3c0b038 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:47.011302 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-f852543d-93ae-41d3-8a0e-f1c6a3c0b038 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:47.012548 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-f852543d-93ae-41d3-8a0e-f1c6a3c0b038 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1807 microversion: 2.20 time: 0.324661 Aug 30 01:08:47.013121 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 410/811] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:46 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1807 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:48.041187 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-09bacf13-5c81-46b6-9576-0a561c7defc1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:48.041774 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-09bacf13-5c81-46b6-9576-0a561c7defc1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:48.048441 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-09bacf13-5c81-46b6-9576-0a561c7defc1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:48.049578 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-09bacf13-5c81-46b6-9576-0a561c7defc1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:48.050017 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-09bacf13-5c81-46b6-9576-0a561c7defc1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:48.050760 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-09bacf13-5c81-46b6-9576-0a561c7defc1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:48.051215 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-09bacf13-5c81-46b6-9576-0a561c7defc1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:48.051630 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-09bacf13-5c81-46b6-9576-0a561c7defc1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:48.197221 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-09bacf13-5c81-46b6-9576-0a561c7defc1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:48.213025 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-09bacf13-5c81-46b6-9576-0a561c7defc1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:48.214857 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-09bacf13-5c81-46b6-9576-0a561c7defc1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:48.216497 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-09bacf13-5c81-46b6-9576-0a561c7defc1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1807 microversion: 2.20 time: 0.179213 Aug 30 01:08:48.217159 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 402/812] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:48 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:49.241246 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-13530052-8b19-496c-8f5c-3677815ed8e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:49.243606 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-13530052-8b19-496c-8f5c-3677815ed8e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:49.251540 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-13530052-8b19-496c-8f5c-3677815ed8e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:49.252207 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-13530052-8b19-496c-8f5c-3677815ed8e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:49.253454 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-13530052-8b19-496c-8f5c-3677815ed8e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:49.254277 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-13530052-8b19-496c-8f5c-3677815ed8e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:49.254835 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-13530052-8b19-496c-8f5c-3677815ed8e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:49.255500 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-13530052-8b19-496c-8f5c-3677815ed8e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:49.404502 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-13530052-8b19-496c-8f5c-3677815ed8e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:49.413806 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-13530052-8b19-496c-8f5c-3677815ed8e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:49.415952 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-13530052-8b19-496c-8f5c-3677815ed8e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:49.417285 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-13530052-8b19-496c-8f5c-3677815ed8e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1807 microversion: 2.20 time: 0.180173 Aug 30 01:08:49.417945 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 411/813] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:49 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:50.441197 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-f11af862-5ae3-40eb-b779-3dceb81120ea tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:50.441811 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-f11af862-5ae3-40eb-b779-3dceb81120ea tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:50.448122 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f11af862-5ae3-40eb-b779-3dceb81120ea tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:50.448608 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f11af862-5ae3-40eb-b779-3dceb81120ea tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:50.449052 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f11af862-5ae3-40eb-b779-3dceb81120ea tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:50.449854 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f11af862-5ae3-40eb-b779-3dceb81120ea tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:50.450314 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f11af862-5ae3-40eb-b779-3dceb81120ea tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:50.450738 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f11af862-5ae3-40eb-b779-3dceb81120ea tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:50.453455 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:50.619628 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-f11af862-5ae3-40eb-b779-3dceb81120ea tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:50.629035 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-f11af862-5ae3-40eb-b779-3dceb81120ea tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:50.630514 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-f11af862-5ae3-40eb-b779-3dceb81120ea tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:50.631684 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-f11af862-5ae3-40eb-b779-3dceb81120ea tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1807 microversion: 2.20 time: 0.194364 Aug 30 01:08:50.632246 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 403/814] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:50 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:51.657978 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-a499418e-c311-4ce2-af68-2f9cd2fc845f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:51.659387 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-a499418e-c311-4ce2-af68-2f9cd2fc845f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:51.671918 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a499418e-c311-4ce2-af68-2f9cd2fc845f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:51.672433 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a499418e-c311-4ce2-af68-2f9cd2fc845f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:51.672883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a499418e-c311-4ce2-af68-2f9cd2fc845f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:51.673634 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a499418e-c311-4ce2-af68-2f9cd2fc845f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:51.677704 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a499418e-c311-4ce2-af68-2f9cd2fc845f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:51.678497 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a499418e-c311-4ce2-af68-2f9cd2fc845f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:51.695537 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:51.964116 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-a499418e-c311-4ce2-af68-2f9cd2fc845f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:51.976764 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-a499418e-c311-4ce2-af68-2f9cd2fc845f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:51.979395 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-a499418e-c311-4ce2-af68-2f9cd2fc845f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:51.982973 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-a499418e-c311-4ce2-af68-2f9cd2fc845f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1807 microversion: 2.20 time: 0.332268 Aug 30 01:08:51.983544 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 412/815] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:51 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1807 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:53.010113 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-44e94b95-dbf4-4d38-8eaf-9d4155f10d1d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:53.010774 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-44e94b95-dbf4-4d38-8eaf-9d4155f10d1d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:53.018149 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-44e94b95-dbf4-4d38-8eaf-9d4155f10d1d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:53.018640 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-44e94b95-dbf4-4d38-8eaf-9d4155f10d1d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:53.019079 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-44e94b95-dbf4-4d38-8eaf-9d4155f10d1d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:53.019779 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-44e94b95-dbf4-4d38-8eaf-9d4155f10d1d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:53.020237 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-44e94b95-dbf4-4d38-8eaf-9d4155f10d1d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:53.020661 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-44e94b95-dbf4-4d38-8eaf-9d4155f10d1d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:53.158631 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-44e94b95-dbf4-4d38-8eaf-9d4155f10d1d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:53.167207 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-44e94b95-dbf4-4d38-8eaf-9d4155f10d1d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:53.168781 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-44e94b95-dbf4-4d38-8eaf-9d4155f10d1d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:53.170038 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-44e94b95-dbf4-4d38-8eaf-9d4155f10d1d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1807 microversion: 2.20 time: 0.163905 Aug 30 01:08:53.170607 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 404/816] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:53 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:54.195677 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f5b3b99a-4ae2-4ce0-9475-e54d6ed5b4e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:54.196286 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-f5b3b99a-4ae2-4ce0-9475-e54d6ed5b4e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:54.203029 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f5b3b99a-4ae2-4ce0-9475-e54d6ed5b4e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:54.203520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f5b3b99a-4ae2-4ce0-9475-e54d6ed5b4e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:54.203975 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f5b3b99a-4ae2-4ce0-9475-e54d6ed5b4e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:54.204652 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f5b3b99a-4ae2-4ce0-9475-e54d6ed5b4e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:54.205128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f5b3b99a-4ae2-4ce0-9475-e54d6ed5b4e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:54.205553 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f5b3b99a-4ae2-4ce0-9475-e54d6ed5b4e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:54.379482 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-f5b3b99a-4ae2-4ce0-9475-e54d6ed5b4e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:54.388584 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-f5b3b99a-4ae2-4ce0-9475-e54d6ed5b4e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:54.390072 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-f5b3b99a-4ae2-4ce0-9475-e54d6ed5b4e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:54.391603 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-f5b3b99a-4ae2-4ce0-9475-e54d6ed5b4e1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1807 microversion: 2.20 time: 0.199818 Aug 30 01:08:54.392598 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 413/817] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:54 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1807 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:55.415548 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-ca8ceb19-ec95-4384-b5b2-a8546b51af04 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:55.416182 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-ca8ceb19-ec95-4384-b5b2-a8546b51af04 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:55.422907 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ca8ceb19-ec95-4384-b5b2-a8546b51af04 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:55.423394 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ca8ceb19-ec95-4384-b5b2-a8546b51af04 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:55.423830 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ca8ceb19-ec95-4384-b5b2-a8546b51af04 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:55.424527 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ca8ceb19-ec95-4384-b5b2-a8546b51af04 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:55.424979 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ca8ceb19-ec95-4384-b5b2-a8546b51af04 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:55.425431 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ca8ceb19-ec95-4384-b5b2-a8546b51af04 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:55.561566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-ca8ceb19-ec95-4384-b5b2-a8546b51af04 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:55.570896 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-ca8ceb19-ec95-4384-b5b2-a8546b51af04 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:55.573251 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-ca8ceb19-ec95-4384-b5b2-a8546b51af04 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:55.573615 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-ca8ceb19-ec95-4384-b5b2-a8546b51af04 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1807 microversion: 2.20 time: 0.162222 Aug 30 01:08:55.574175 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 405/818] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:55 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:56.597411 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4947d73f-730b-4f68-8adf-d28cf76af895 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:56.598137 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-4947d73f-730b-4f68-8adf-d28cf76af895 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:56.605172 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4947d73f-730b-4f68-8adf-d28cf76af895 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:56.605748 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4947d73f-730b-4f68-8adf-d28cf76af895 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:56.606249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4947d73f-730b-4f68-8adf-d28cf76af895 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:56.608026 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4947d73f-730b-4f68-8adf-d28cf76af895 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:56.608454 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4947d73f-730b-4f68-8adf-d28cf76af895 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:56.609571 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4947d73f-730b-4f68-8adf-d28cf76af895 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:56.753560 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-4947d73f-730b-4f68-8adf-d28cf76af895 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:56.762274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-4947d73f-730b-4f68-8adf-d28cf76af895 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:56.764591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-4947d73f-730b-4f68-8adf-d28cf76af895 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:56.765801 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-4947d73f-730b-4f68-8adf-d28cf76af895 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1807 microversion: 2.20 time: 0.172314 Aug 30 01:08:56.766356 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 414/819] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:56 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:57.789398 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-f65a6e69-36de-49e6-90e1-c0108a4a2ab4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:57.790118 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-f65a6e69-36de-49e6-90e1-c0108a4a2ab4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:57.798457 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f65a6e69-36de-49e6-90e1-c0108a4a2ab4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:57.799050 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f65a6e69-36de-49e6-90e1-c0108a4a2ab4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:57.799485 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f65a6e69-36de-49e6-90e1-c0108a4a2ab4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:57.800458 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f65a6e69-36de-49e6-90e1-c0108a4a2ab4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:57.800908 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f65a6e69-36de-49e6-90e1-c0108a4a2ab4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:57.801494 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f65a6e69-36de-49e6-90e1-c0108a4a2ab4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:57.940120 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-f65a6e69-36de-49e6-90e1-c0108a4a2ab4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:57.948842 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-f65a6e69-36de-49e6-90e1-c0108a4a2ab4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:57.951015 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-f65a6e69-36de-49e6-90e1-c0108a4a2ab4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:57.952332 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-f65a6e69-36de-49e6-90e1-c0108a4a2ab4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1807 microversion: 2.20 time: 0.166724 Aug 30 01:08:57.952899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 406/820] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:57 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:58.976114 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-6d8e9ed8-47c5-4764-b342-a5d6c2e169d1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:58.976791 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-6d8e9ed8-47c5-4764-b342-a5d6c2e169d1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:58.986732 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6d8e9ed8-47c5-4764-b342-a5d6c2e169d1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:58.986732 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6d8e9ed8-47c5-4764-b342-a5d6c2e169d1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:58.986732 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6d8e9ed8-47c5-4764-b342-a5d6c2e169d1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:58.986732 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6d8e9ed8-47c5-4764-b342-a5d6c2e169d1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:58.987154 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6d8e9ed8-47c5-4764-b342-a5d6c2e169d1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:58.987154 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6d8e9ed8-47c5-4764-b342-a5d6c2e169d1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:59.127570 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-6d8e9ed8-47c5-4764-b342-a5d6c2e169d1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:59.137358 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-6d8e9ed8-47c5-4764-b342-a5d6c2e169d1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:59.139349 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-6d8e9ed8-47c5-4764-b342-a5d6c2e169d1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:59.140611 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-6d8e9ed8-47c5-4764-b342-a5d6c2e169d1 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1807 microversion: 2.20 time: 0.168462 Aug 30 01:08:59.141210 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 415/821] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:08:58 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:09:00.170603 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-90d7f53c-6393-41d8-96b1-4f243aff2808 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:00.171294 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-90d7f53c-6393-41d8-96b1-4f243aff2808 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:00.174980 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:00.178613 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-90d7f53c-6393-41d8-96b1-4f243aff2808 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:00.179101 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-90d7f53c-6393-41d8-96b1-4f243aff2808 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:00.179714 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-90d7f53c-6393-41d8-96b1-4f243aff2808 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:00.180431 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-90d7f53c-6393-41d8-96b1-4f243aff2808 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:00.180871 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-90d7f53c-6393-41d8-96b1-4f243aff2808 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:00.181491 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-90d7f53c-6393-41d8-96b1-4f243aff2808 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:00.436931 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-90d7f53c-6393-41d8-96b1-4f243aff2808 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:00.446172 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-90d7f53c-6393-41d8-96b1-4f243aff2808 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:00.447813 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-90d7f53c-6393-41d8-96b1-4f243aff2808 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:00.449138 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-90d7f53c-6393-41d8-96b1-4f243aff2808 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1807 microversion: 2.20 time: 0.282911 Aug 30 01:09:00.449806 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 407/822] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:09:00 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1807 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:09:00.920690 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-d8c5b969-4fac-447b-9139-88d720f9513e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1629694563", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1418735735", "security_groups": [{"name": "tempest-secgroup-smoke-1850089549"}], "block_device_mapping_v2": [{"uuid": "6e761037-62fc-43d0-9d3c-568c121a88ee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9040a016-54c8-479a-991b-4e0ac5fa178d"}]}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:00.935387 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=28 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:01.119691 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.network.neutron [None req-d8c5b969-4fac-447b-9139-88d720f9513e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] validate_networks() for [('9040a016-54c8-479a-991b-4e0ac5fa178d', None, None, None, None, None)] {{(pid=120630) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:09:01.472484 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-d6a4a105-6f51-465d-9444-ca201a24da65 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:01.473879 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-d6a4a105-6f51-465d-9444-ca201a24da65 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:01.480842 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d6a4a105-6f51-465d-9444-ca201a24da65 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:01.481531 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d6a4a105-6f51-465d-9444-ca201a24da65 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:01.482053 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d6a4a105-6f51-465d-9444-ca201a24da65 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:01.482826 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d6a4a105-6f51-465d-9444-ca201a24da65 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:01.483502 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d6a4a105-6f51-465d-9444-ca201a24da65 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:01.483992 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d6a4a105-6f51-465d-9444-ca201a24da65 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:01.798009 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-d6a4a105-6f51-465d-9444-ca201a24da65 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:01.807431 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-d6a4a105-6f51-465d-9444-ca201a24da65 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:01.809224 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-d6a4a105-6f51-465d-9444-ca201a24da65 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:01.810676 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-d6a4a105-6f51-465d-9444-ca201a24da65 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1807 microversion: 2.20 time: 0.342065 Aug 30 01:09:01.825976 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 408/823] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:09:01 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1807 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:09:02.238203 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-d8c5b969-4fac-447b-9139-88d720f9513e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Flavor limits 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:09:02.238612 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-d8c5b969-4fac-447b-9139-88d720f9513e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Image limits 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:09:02.239076 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-d8c5b969-4fac-447b-9139-88d720f9513e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Flavor pref 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:09:02.239805 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-d8c5b969-4fac-447b-9139-88d720f9513e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Image pref 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:09:02.240221 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-d8c5b969-4fac-447b-9139-88d720f9513e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:09:02.250477 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d8c5b969-4fac-447b-9139-88d720f9513e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:02.251154 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d8c5b969-4fac-447b-9139-88d720f9513e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:02.251586 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d8c5b969-4fac-447b-9139-88d720f9513e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:02.252480 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d8c5b969-4fac-447b-9139-88d720f9513e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:02.253104 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d8c5b969-4fac-447b-9139-88d720f9513e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:02.253686 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d8c5b969-4fac-447b-9139-88d720f9513e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:02.277393 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-d8c5b969-4fac-447b-9139-88d720f9513e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Getting quotas for project a6380baa172744fa9d7ba5b81f847906. Resources: {'ram', 'instances', 'cores'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:09:02.285110 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-d8c5b969-4fac-447b-9139-88d720f9513e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Getting quotas for user d467895d586a43719d2abdf4105187f8 and project a6380baa172744fa9d7ba5b81f847906. Resources: {'ram', 'instances', 'cores'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:09:02.394954 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-d8c5b969-4fac-447b-9139-88d720f9513e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Going to run 1 instances... {{(pid=120630) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:09:02.397131 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-d8c5b969-4fac-447b-9139-88d720f9513e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6e761037-62fc-43d0-9d3c-568c121a88ee',volume_size=None,volume_type=None)] {{(pid=120630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:09:02.609742 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-d8c5b969-4fac-447b-9139-88d720f9513e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.697514 Aug 30 01:09:02.612863 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 416/824] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 30 01:09:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:09:02.620982 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-484e7bd5-0774-48f4-a4c5-54d32930c5d6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:02.623199 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-484e7bd5-0774-48f4-a4c5-54d32930c5d6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:02.733975 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-484e7bd5-0774-48f4-a4c5-54d32930c5d6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:02.741358 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-484e7bd5-0774-48f4-a4c5-54d32930c5d6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 200 len: 1095 microversion: 2.1 time: 0.124009 Aug 30 01:09:02.742593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 409/825] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:02 2022] GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 1095 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:09:02.836401 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-b321ea2d-831a-4049-8ea1-26a40a730a05 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:02.837455 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-b321ea2d-831a-4049-8ea1-26a40a730a05 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:02.847534 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b321ea2d-831a-4049-8ea1-26a40a730a05 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:02.847534 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b321ea2d-831a-4049-8ea1-26a40a730a05 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:02.847917 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b321ea2d-831a-4049-8ea1-26a40a730a05 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:02.848632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b321ea2d-831a-4049-8ea1-26a40a730a05 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:02.849136 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b321ea2d-831a-4049-8ea1-26a40a730a05 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:02.849708 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b321ea2d-831a-4049-8ea1-26a40a730a05 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:03.027362 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-b321ea2d-831a-4049-8ea1-26a40a730a05 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:03.038127 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-b321ea2d-831a-4049-8ea1-26a40a730a05 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:03.039912 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-b321ea2d-831a-4049-8ea1-26a40a730a05 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:03.041349 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-b321ea2d-831a-4049-8ea1-26a40a730a05 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1807 microversion: 2.20 time: 0.208992 Aug 30 01:09:03.053586 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 417/826] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:09:02 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:09:03.766816 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-5cb8110c-a6ea-452c-a015-117c764a894e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:03.768464 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-5cb8110c-a6ea-452c-a015-117c764a894e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:03.780234 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5cb8110c-a6ea-452c-a015-117c764a894e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:03.781097 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5cb8110c-a6ea-452c-a015-117c764a894e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:03.781740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5cb8110c-a6ea-452c-a015-117c764a894e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:03.782724 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5cb8110c-a6ea-452c-a015-117c764a894e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:03.783380 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5cb8110c-a6ea-452c-a015-117c764a894e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:03.784025 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5cb8110c-a6ea-452c-a015-117c764a894e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:03.913724 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-5cb8110c-a6ea-452c-a015-117c764a894e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:03.932062 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-5cb8110c-a6ea-452c-a015-117c764a894e tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 200 len: 1193 microversion: 2.1 time: 0.170455 Aug 30 01:09:03.935628 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 410/827] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:03 2022] GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 1193 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:04.073611 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-7dcc5676-ddeb-46cb-bf0b-c61bf1d8d354 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:04.076617 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-7dcc5676-ddeb-46cb-bf0b-c61bf1d8d354 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:04.088357 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7dcc5676-ddeb-46cb-bf0b-c61bf1d8d354 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:04.090161 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7dcc5676-ddeb-46cb-bf0b-c61bf1d8d354 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:04.092287 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7dcc5676-ddeb-46cb-bf0b-c61bf1d8d354 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:04.093500 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7dcc5676-ddeb-46cb-bf0b-c61bf1d8d354 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:04.094116 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7dcc5676-ddeb-46cb-bf0b-c61bf1d8d354 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:04.094964 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7dcc5676-ddeb-46cb-bf0b-c61bf1d8d354 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:04.398941 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7dcc5676-ddeb-46cb-bf0b-c61bf1d8d354 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:04.409739 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7dcc5676-ddeb-46cb-bf0b-c61bf1d8d354 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:04.411217 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7dcc5676-ddeb-46cb-bf0b-c61bf1d8d354 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:04.412660 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-7dcc5676-ddeb-46cb-bf0b-c61bf1d8d354 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1807 microversion: 2.20 time: 0.347290 Aug 30 01:09:04.413493 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 418/828] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:09:04 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1807 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:09:04.956106 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-8e15644f-cbc7-45b7-bc89-c25598a15ec0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:04.957377 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-8e15644f-cbc7-45b7-bc89-c25598a15ec0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:04.977345 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8e15644f-cbc7-45b7-bc89-c25598a15ec0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:04.977904 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8e15644f-cbc7-45b7-bc89-c25598a15ec0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:04.982247 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8e15644f-cbc7-45b7-bc89-c25598a15ec0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:04.983206 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8e15644f-cbc7-45b7-bc89-c25598a15ec0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:04.984032 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8e15644f-cbc7-45b7-bc89-c25598a15ec0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:04.984391 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8e15644f-cbc7-45b7-bc89-c25598a15ec0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:05.061097 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-620b6946-cb05-4df5-b299-eb306c980564 req-5d58fe0f-1203-43e8-be06-a43f90bda600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9b5386-7fbc-4d22-a388-55c656bf9255", "name": "network-vif-plugged", "status": "completed", "tag": "f87d3a77-05ed-43ac-b192-82ed7d858c40"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:05.079849 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-620b6946-cb05-4df5-b299-eb306c980564 req-5d58fe0f-1203-43e8-be06-a43f90bda600 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:05.080568 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-620b6946-cb05-4df5-b299-eb306c980564 req-5d58fe0f-1203-43e8-be06-a43f90bda600 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:05.082061 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-620b6946-cb05-4df5-b299-eb306c980564 req-5d58fe0f-1203-43e8-be06-a43f90bda600 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:05.112041 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-620b6946-cb05-4df5-b299-eb306c980564 req-5d58fe0f-1203-43e8-be06-a43f90bda600 service nova] Creating event network-vif-plugged:f87d3a77-05ed-43ac-b192-82ed7d858c40 for instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 on hv-cinder-81514 Aug 30 01:09:05.137555 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-620b6946-cb05-4df5-b299-eb306c980564 req-5d58fe0f-1203-43e8-be06-a43f90bda600 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080930 Aug 30 01:09:05.140145 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 419/829] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 30 01:09:05.175681 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-8e15644f-cbc7-45b7-bc89-c25598a15ec0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:05.208880 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-8e15644f-cbc7-45b7-bc89-c25598a15ec0 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 200 len: 1211 microversion: 2.1 time: 0.257085 Aug 30 01:09:05.211235 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 411/830] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:04 2022] GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 1211 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:05.440837 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-5cab4ddf-6e3a-4e38-9093-9a8dbed3984c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:05.441894 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-5cab4ddf-6e3a-4e38-9093-9a8dbed3984c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:05.452821 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5cab4ddf-6e3a-4e38-9093-9a8dbed3984c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:05.453638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5cab4ddf-6e3a-4e38-9093-9a8dbed3984c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:05.454624 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5cab4ddf-6e3a-4e38-9093-9a8dbed3984c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:05.456012 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5cab4ddf-6e3a-4e38-9093-9a8dbed3984c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:05.456634 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5cab4ddf-6e3a-4e38-9093-9a8dbed3984c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:05.457503 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5cab4ddf-6e3a-4e38-9093-9a8dbed3984c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:05.840044 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-5cab4ddf-6e3a-4e38-9093-9a8dbed3984c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:05.852232 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-5cab4ddf-6e3a-4e38-9093-9a8dbed3984c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:05.854210 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-5cab4ddf-6e3a-4e38-9093-9a8dbed3984c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:05.859458 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-5cab4ddf-6e3a-4e38-9093-9a8dbed3984c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1807 microversion: 2.20 time: 0.425567 Aug 30 01:09:05.866571 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 420/831] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:09:05 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1807 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:09:06.232523 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-6aa4c98c-4d1f-499a-aa6e-3dabcbb685ca tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:06.233283 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-6aa4c98c-4d1f-499a-aa6e-3dabcbb685ca tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:06.243689 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6aa4c98c-4d1f-499a-aa6e-3dabcbb685ca tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:06.245818 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6aa4c98c-4d1f-499a-aa6e-3dabcbb685ca tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:06.246253 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6aa4c98c-4d1f-499a-aa6e-3dabcbb685ca tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:06.247509 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6aa4c98c-4d1f-499a-aa6e-3dabcbb685ca tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:06.247757 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6aa4c98c-4d1f-499a-aa6e-3dabcbb685ca tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:06.248293 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6aa4c98c-4d1f-499a-aa6e-3dabcbb685ca tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:06.530748 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6aa4c98c-4d1f-499a-aa6e-3dabcbb685ca tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:06.544082 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-6aa4c98c-4d1f-499a-aa6e-3dabcbb685ca tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 200 len: 1267 microversion: 2.1 time: 0.315469 Aug 30 01:09:06.560870 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 412/832] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:06 2022] GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 1267 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:06.604688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-5cda2a4d-778a-47a2-b24c-3c632694ec6e req-da91b0ab-02cc-4945-ae72-a55fa322f6e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d3e6518-0173-4f31-ba51-d3fe0f2980e0", "tag": "45ea4fde-69bf-4651-956f-e265b3f4ca34"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:06.651227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-5cda2a4d-778a-47a2-b24c-3c632694ec6e req-da91b0ab-02cc-4945-ae72-a55fa322f6e8 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:06.651983 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-5cda2a4d-778a-47a2-b24c-3c632694ec6e req-da91b0ab-02cc-4945-ae72-a55fa322f6e8 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:06.654913 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-5cda2a4d-778a-47a2-b24c-3c632694ec6e req-da91b0ab-02cc-4945-ae72-a55fa322f6e8 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:06.710039 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-5cda2a4d-778a-47a2-b24c-3c632694ec6e req-da91b0ab-02cc-4945-ae72-a55fa322f6e8 service nova] Creating event network-changed:45ea4fde-69bf-4651-956f-e265b3f4ca34 for instance 9d3e6518-0173-4f31-ba51-d3fe0f2980e0 on hv-cinder-81514 Aug 30 01:09:06.730352 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-5cda2a4d-778a-47a2-b24c-3c632694ec6e req-da91b0ab-02cc-4945-ae72-a55fa322f6e8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134576 Aug 30 01:09:06.734086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 421/833] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:06.891718 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-c0b88155-314b-49fc-a891-226769d881c0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:06.892339 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-c0b88155-314b-49fc-a891-226769d881c0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:06.903084 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c0b88155-314b-49fc-a891-226769d881c0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:06.903854 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c0b88155-314b-49fc-a891-226769d881c0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:06.904348 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c0b88155-314b-49fc-a891-226769d881c0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:06.906982 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c0b88155-314b-49fc-a891-226769d881c0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:06.907457 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c0b88155-314b-49fc-a891-226769d881c0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:06.909057 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c0b88155-314b-49fc-a891-226769d881c0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:07.086481 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-c0b88155-314b-49fc-a891-226769d881c0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:07.096912 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-c0b88155-314b-49fc-a891-226769d881c0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:07.098777 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-c0b88155-314b-49fc-a891-226769d881c0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:07.099987 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-c0b88155-314b-49fc-a891-226769d881c0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1807 microversion: 2.20 time: 0.212604 Aug 30 01:09:07.100555 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 413/834] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:09:06 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1807 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:09:07.569660 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-e3106eeb-3dc1-497d-a433-54a4d8ae077d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:07.570781 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-e3106eeb-3dc1-497d-a433-54a4d8ae077d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:07.585706 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e3106eeb-3dc1-497d-a433-54a4d8ae077d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:07.589367 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e3106eeb-3dc1-497d-a433-54a4d8ae077d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:07.590068 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e3106eeb-3dc1-497d-a433-54a4d8ae077d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:07.591112 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e3106eeb-3dc1-497d-a433-54a4d8ae077d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:07.593866 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e3106eeb-3dc1-497d-a433-54a4d8ae077d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:07.595113 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e3106eeb-3dc1-497d-a433-54a4d8ae077d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:07.928769 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-e3106eeb-3dc1-497d-a433-54a4d8ae077d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:07.945831 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-e3106eeb-3dc1-497d-a433-54a4d8ae077d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 200 len: 1267 microversion: 2.1 time: 0.382273 Aug 30 01:09:07.948441 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 422/835] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:07 2022] GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 1267 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:08.125014 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3a5143cc-e5c6-4d74-8bdc-8e12dda25539 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:08.127606 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-3a5143cc-e5c6-4d74-8bdc-8e12dda25539 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:08.140108 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3a5143cc-e5c6-4d74-8bdc-8e12dda25539 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:08.143179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3a5143cc-e5c6-4d74-8bdc-8e12dda25539 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:08.143854 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3a5143cc-e5c6-4d74-8bdc-8e12dda25539 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:08.144759 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3a5143cc-e5c6-4d74-8bdc-8e12dda25539 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:08.146969 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3a5143cc-e5c6-4d74-8bdc-8e12dda25539 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:08.149295 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3a5143cc-e5c6-4d74-8bdc-8e12dda25539 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:08.972613 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-5c705a5e-8fe0-436f-b4dd-74a83aa81d76 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:08.973967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-5c705a5e-8fe0-436f-b4dd-74a83aa81d76 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:09.011980 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5c705a5e-8fe0-436f-b4dd-74a83aa81d76 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:09.012667 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5c705a5e-8fe0-436f-b4dd-74a83aa81d76 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:09.013961 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5c705a5e-8fe0-436f-b4dd-74a83aa81d76 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:09.015481 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5c705a5e-8fe0-436f-b4dd-74a83aa81d76 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:09.016594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5c705a5e-8fe0-436f-b4dd-74a83aa81d76 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:09.017578 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5c705a5e-8fe0-436f-b4dd-74a83aa81d76 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:09.071001 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3a5143cc-e5c6-4d74-8bdc-8e12dda25539 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:09.088049 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3a5143cc-e5c6-4d74-8bdc-8e12dda25539 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:09.098208 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3a5143cc-e5c6-4d74-8bdc-8e12dda25539 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:09.114782 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3a5143cc-e5c6-4d74-8bdc-8e12dda25539 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1807 microversion: 2.20 time: 0.993639 Aug 30 01:09:09.120263 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 414/836] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:09:08 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1807 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:09:09.395958 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-5c705a5e-8fe0-436f-b4dd-74a83aa81d76 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:09.414519 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-5c705a5e-8fe0-436f-b4dd-74a83aa81d76 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 200 len: 1267 microversion: 2.1 time: 0.447348 Aug 30 01:09:09.416289 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 423/837] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:08 2022] GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 1267 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:09:10.146464 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-16d78fe5-879b-4193-9fd2-f16c76456704 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:10.147182 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-16d78fe5-879b-4193-9fd2-f16c76456704 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:10.157659 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-16d78fe5-879b-4193-9fd2-f16c76456704 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:10.158513 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-16d78fe5-879b-4193-9fd2-f16c76456704 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:10.159256 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-16d78fe5-879b-4193-9fd2-f16c76456704 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:10.160562 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-16d78fe5-879b-4193-9fd2-f16c76456704 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:10.161300 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-16d78fe5-879b-4193-9fd2-f16c76456704 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:10.162227 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-16d78fe5-879b-4193-9fd2-f16c76456704 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:10.442690 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-591b1574-cbf3-4e4f-9ab6-2683a4e5c007 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:10.443330 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-591b1574-cbf3-4e4f-9ab6-2683a4e5c007 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:10.457956 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-591b1574-cbf3-4e4f-9ab6-2683a4e5c007 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:10.458581 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-591b1574-cbf3-4e4f-9ab6-2683a4e5c007 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:10.459042 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-591b1574-cbf3-4e4f-9ab6-2683a4e5c007 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:10.459791 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-591b1574-cbf3-4e4f-9ab6-2683a4e5c007 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:10.460250 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-591b1574-cbf3-4e4f-9ab6-2683a4e5c007 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:10.460678 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-591b1574-cbf3-4e4f-9ab6-2683a4e5c007 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:10.486586 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-16d78fe5-879b-4193-9fd2-f16c76456704 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:10.506464 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-16d78fe5-879b-4193-9fd2-f16c76456704 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:10.510280 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-16d78fe5-879b-4193-9fd2-f16c76456704 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:10.516926 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-16d78fe5-879b-4193-9fd2-f16c76456704 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1794 microversion: 2.20 time: 0.374278 Aug 30 01:09:10.530143 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 415/838] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:09:10 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1794 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:09:10.789031 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-591b1574-cbf3-4e4f-9ab6-2683a4e5c007 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:10.800239 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-591b1574-cbf3-4e4f-9ab6-2683a4e5c007 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 200 len: 1267 microversion: 2.1 time: 0.359246 Aug 30 01:09:10.802063 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 424/839] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:10 2022] GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 1267 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:11.824605 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-236aa45f-1b1f-434a-921c-de509a4999c2 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:11.825959 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-236aa45f-1b1f-434a-921c-de509a4999c2 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:11.832689 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-236aa45f-1b1f-434a-921c-de509a4999c2 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:11.833485 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-236aa45f-1b1f-434a-921c-de509a4999c2 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:11.834142 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-236aa45f-1b1f-434a-921c-de509a4999c2 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:11.835039 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-236aa45f-1b1f-434a-921c-de509a4999c2 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:11.835837 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-236aa45f-1b1f-434a-921c-de509a4999c2 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:11.836490 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-236aa45f-1b1f-434a-921c-de509a4999c2 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:11.985501 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-236aa45f-1b1f-434a-921c-de509a4999c2 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:11.993528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-236aa45f-1b1f-434a-921c-de509a4999c2 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 200 len: 1267 microversion: 2.1 time: 0.173556 Aug 30 01:09:11.994102 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 416/840] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:11 2022] GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:13.016106 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-3f68f3a8-9a9b-4354-8907-ceff1140a1ff tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:13.016834 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-3f68f3a8-9a9b-4354-8907-ceff1140a1ff tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:13.020263 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=2 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:13.020867 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=6 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:13.024936 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3f68f3a8-9a9b-4354-8907-ceff1140a1ff tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:13.025793 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3f68f3a8-9a9b-4354-8907-ceff1140a1ff tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:13.026427 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3f68f3a8-9a9b-4354-8907-ceff1140a1ff tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:13.028684 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3f68f3a8-9a9b-4354-8907-ceff1140a1ff tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:13.029036 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3f68f3a8-9a9b-4354-8907-ceff1140a1ff tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:13.029527 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3f68f3a8-9a9b-4354-8907-ceff1140a1ff tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:13.193123 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=2 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:13.230022 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-3f68f3a8-9a9b-4354-8907-ceff1140a1ff tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:13.238555 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-3f68f3a8-9a9b-4354-8907-ceff1140a1ff tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 200 len: 1267 microversion: 2.1 time: 0.226920 Aug 30 01:09:13.249471 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 425/841] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:13 2022] GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:13.435823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3947eed2-2238-4060-a7d7-08228e86764d tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Action: 'create', calling method: .version_select at 0x7f0f5288ba60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1664379396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaxkoXCi/HqUmBd3hbJnAVnUIgSA4D7OsP2NjWheIZxObO7EJp/NOkh+orqVn1gY93ikwf90wX9RXPlXpgw7b5IqIs9w4uicv08/6lDc0nhRyv9SrkJrPmqe8cWm/fBrQ=="}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:13.453692 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-3947eed2-2238-4060-a7d7-08228e86764d tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Getting quotas for project aa4d639296c34f1dbf0b327fd0828620. Resources: {'key_pairs'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:09:13.457808 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-3947eed2-2238-4060-a7d7-08228e86764d tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Getting quotas for user 21a84ede2a594f7ab23b442baa9f2f5a and project aa4d639296c34f1dbf0b327fd0828620. Resources: {'key_pairs'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:09:13.486059 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3947eed2-2238-4060-a7d7-08228e86764d tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.300130 Aug 30 01:09:13.487263 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 417/842] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 30 01:09:13 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:14.260694 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-2fb9d4df-7525-4865-96fc-c7f78aca5fb6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:14.262917 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-2fb9d4df-7525-4865-96fc-c7f78aca5fb6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:14.271581 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2fb9d4df-7525-4865-96fc-c7f78aca5fb6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:14.272640 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2fb9d4df-7525-4865-96fc-c7f78aca5fb6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:14.274070 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2fb9d4df-7525-4865-96fc-c7f78aca5fb6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:14.275063 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2fb9d4df-7525-4865-96fc-c7f78aca5fb6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:14.275767 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2fb9d4df-7525-4865-96fc-c7f78aca5fb6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:14.276369 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2fb9d4df-7525-4865-96fc-c7f78aca5fb6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:14.483556 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-2fb9d4df-7525-4865-96fc-c7f78aca5fb6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:14.493136 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-2fb9d4df-7525-4865-96fc-c7f78aca5fb6 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 200 len: 1267 microversion: 2.1 time: 0.237038 Aug 30 01:09:14.494410 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 426/843] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:14 2022] GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:15.520271 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-a58d3a90-5dac-4702-81bb-023d0d89e8c4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:15.520881 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-a58d3a90-5dac-4702-81bb-023d0d89e8c4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:15.529016 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a58d3a90-5dac-4702-81bb-023d0d89e8c4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:15.529597 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a58d3a90-5dac-4702-81bb-023d0d89e8c4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:15.530035 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a58d3a90-5dac-4702-81bb-023d0d89e8c4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:15.530773 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a58d3a90-5dac-4702-81bb-023d0d89e8c4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:15.531333 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a58d3a90-5dac-4702-81bb-023d0d89e8c4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:15.531805 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a58d3a90-5dac-4702-81bb-023d0d89e8c4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:15.679483 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-a58d3a90-5dac-4702-81bb-023d0d89e8c4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:15.690199 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-a58d3a90-5dac-4702-81bb-023d0d89e8c4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 200 len: 1267 microversion: 2.1 time: 0.174928 Aug 30 01:09:15.690924 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 418/844] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:15 2022] GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:16.711938 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-d117dc0e-7358-4953-adf9-703b36cd81a3 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:16.713285 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-d117dc0e-7358-4953-adf9-703b36cd81a3 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:16.724736 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d117dc0e-7358-4953-adf9-703b36cd81a3 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:16.725405 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d117dc0e-7358-4953-adf9-703b36cd81a3 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:16.725806 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d117dc0e-7358-4953-adf9-703b36cd81a3 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:16.726983 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d117dc0e-7358-4953-adf9-703b36cd81a3 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:16.727453 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d117dc0e-7358-4953-adf9-703b36cd81a3 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:16.727936 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d117dc0e-7358-4953-adf9-703b36cd81a3 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:16.884500 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-d117dc0e-7358-4953-adf9-703b36cd81a3 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:16.892826 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-d117dc0e-7358-4953-adf9-703b36cd81a3 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 200 len: 1267 microversion: 2.1 time: 0.184796 Aug 30 01:09:16.893420 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 427/845] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:16 2022] GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:09:17.915076 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e2ec86fd-24c1-48b2-b0f3-9e8977c2a463 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:17.916301 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e2ec86fd-24c1-48b2-b0f3-9e8977c2a463 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:17.924143 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e2ec86fd-24c1-48b2-b0f3-9e8977c2a463 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:17.924831 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e2ec86fd-24c1-48b2-b0f3-9e8977c2a463 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:17.925302 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e2ec86fd-24c1-48b2-b0f3-9e8977c2a463 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:17.926003 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e2ec86fd-24c1-48b2-b0f3-9e8977c2a463 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:17.926453 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e2ec86fd-24c1-48b2-b0f3-9e8977c2a463 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:17.926877 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e2ec86fd-24c1-48b2-b0f3-9e8977c2a463 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:18.094345 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e2ec86fd-24c1-48b2-b0f3-9e8977c2a463 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:18.103246 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e2ec86fd-24c1-48b2-b0f3-9e8977c2a463 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 200 len: 1267 microversion: 2.1 time: 0.192099 Aug 30 01:09:18.103898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 419/846] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:17 2022] GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:18.928158 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-c93848ea-501b-4b5d-99a5-3267d80cc4c7 req-ca26554f-1f64-490f-9b7c-5901f0c5173f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3e6518-0173-4f31-ba51-d3fe0f2980e0", "name": "network-vif-plugged", "status": "completed", "tag": "45ea4fde-69bf-4651-956f-e265b3f4ca34"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:18.943277 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-c93848ea-501b-4b5d-99a5-3267d80cc4c7 req-ca26554f-1f64-490f-9b7c-5901f0c5173f service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:18.943849 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-c93848ea-501b-4b5d-99a5-3267d80cc4c7 req-ca26554f-1f64-490f-9b7c-5901f0c5173f service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:18.944548 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-c93848ea-501b-4b5d-99a5-3267d80cc4c7 req-ca26554f-1f64-490f-9b7c-5901f0c5173f service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:18.957621 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-c93848ea-501b-4b5d-99a5-3267d80cc4c7 req-ca26554f-1f64-490f-9b7c-5901f0c5173f service nova] Creating event network-vif-plugged:45ea4fde-69bf-4651-956f-e265b3f4ca34 for instance 9d3e6518-0173-4f31-ba51-d3fe0f2980e0 on hv-cinder-81514 Aug 30 01:09:18.963143 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-c93848ea-501b-4b5d-99a5-3267d80cc4c7 req-ca26554f-1f64-490f-9b7c-5901f0c5173f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039834 Aug 30 01:09:18.964061 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 428/847] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:09:19.127147 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-d317cc97-34ae-4b51-bc01-d3a1a4c5c629 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:19.128566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-d317cc97-34ae-4b51-bc01-d3a1a4c5c629 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:19.135896 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d317cc97-34ae-4b51-bc01-d3a1a4c5c629 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:19.137032 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d317cc97-34ae-4b51-bc01-d3a1a4c5c629 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:19.137664 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d317cc97-34ae-4b51-bc01-d3a1a4c5c629 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:19.138610 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d317cc97-34ae-4b51-bc01-d3a1a4c5c629 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:19.139247 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d317cc97-34ae-4b51-bc01-d3a1a4c5c629 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:19.140310 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d317cc97-34ae-4b51-bc01-d3a1a4c5c629 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:19.304981 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-d317cc97-34ae-4b51-bc01-d3a1a4c5c629 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:19.313924 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-d317cc97-34ae-4b51-bc01-d3a1a4c5c629 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 200 len: 1267 microversion: 2.1 time: 0.193688 Aug 30 01:09:19.314590 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 420/848] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:19 2022] GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:09:20.345375 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-fd203fc9-0ed9-4fbb-8733-8d8df99a0886 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:20.346141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-fd203fc9-0ed9-4fbb-8733-8d8df99a0886 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:20.352743 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fd203fc9-0ed9-4fbb-8733-8d8df99a0886 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:20.353274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fd203fc9-0ed9-4fbb-8733-8d8df99a0886 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:20.353709 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fd203fc9-0ed9-4fbb-8733-8d8df99a0886 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:20.354403 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fd203fc9-0ed9-4fbb-8733-8d8df99a0886 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:20.355145 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fd203fc9-0ed9-4fbb-8733-8d8df99a0886 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:20.356103 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fd203fc9-0ed9-4fbb-8733-8d8df99a0886 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:20.504168 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-fd203fc9-0ed9-4fbb-8733-8d8df99a0886 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:20.512880 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-fd203fc9-0ed9-4fbb-8733-8d8df99a0886 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 200 len: 1267 microversion: 2.1 time: 0.172076 Aug 30 01:09:20.513482 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 429/849] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:20 2022] GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:21.536404 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-cc6d1498-d41b-44e6-b199-fe197a45797c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:21.537020 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-cc6d1498-d41b-44e6-b199-fe197a45797c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:21.543468 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cc6d1498-d41b-44e6-b199-fe197a45797c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:21.543955 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cc6d1498-d41b-44e6-b199-fe197a45797c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:21.544427 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cc6d1498-d41b-44e6-b199-fe197a45797c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:21.545149 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cc6d1498-d41b-44e6-b199-fe197a45797c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:21.545607 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cc6d1498-d41b-44e6-b199-fe197a45797c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:21.546033 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cc6d1498-d41b-44e6-b199-fe197a45797c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:21.549947 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=96 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:21.685149 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-cc6d1498-d41b-44e6-b199-fe197a45797c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:21.692933 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-cc6d1498-d41b-44e6-b199-fe197a45797c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 200 len: 1454 microversion: 2.1 time: 0.160541 Aug 30 01:09:21.693533 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 421/850] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:21 2022] GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:09:21.713672 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-30fcff0e-e2cd-47bb-9df7-70d4c86a0e82 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:21.714353 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-30fcff0e-e2cd-47bb-9df7-70d4c86a0e82 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:21.720864 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-30fcff0e-e2cd-47bb-9df7-70d4c86a0e82 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:21.721374 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-30fcff0e-e2cd-47bb-9df7-70d4c86a0e82 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:21.721809 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-30fcff0e-e2cd-47bb-9df7-70d4c86a0e82 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:21.722491 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-30fcff0e-e2cd-47bb-9df7-70d4c86a0e82 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:21.722936 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-30fcff0e-e2cd-47bb-9df7-70d4c86a0e82 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:21.723364 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-30fcff0e-e2cd-47bb-9df7-70d4c86a0e82 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:21.860614 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-30fcff0e-e2cd-47bb-9df7-70d4c86a0e82 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:21.862961 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=96 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:21.869848 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-30fcff0e-e2cd-47bb-9df7-70d4c86a0e82 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 200 len: 1454 microversion: 2.1 time: 0.159966 Aug 30 01:09:21.870416 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 430/851] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:21 2022] GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:24.222421 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-111d4004-8c2d-4744-aa7e-27859b3a3153 req-13716ff4-c3a7-4705-8669-b4e13bdac221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d3e6518-0173-4f31-ba51-d3fe0f2980e0", "tag": "45ea4fde-69bf-4651-956f-e265b3f4ca34"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:24.231778 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=4 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:24.233927 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-111d4004-8c2d-4744-aa7e-27859b3a3153 req-13716ff4-c3a7-4705-8669-b4e13bdac221 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:24.234388 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-111d4004-8c2d-4744-aa7e-27859b3a3153 req-13716ff4-c3a7-4705-8669-b4e13bdac221 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:24.234815 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-111d4004-8c2d-4744-aa7e-27859b3a3153 req-13716ff4-c3a7-4705-8669-b4e13bdac221 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:24.246750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-111d4004-8c2d-4744-aa7e-27859b3a3153 req-13716ff4-c3a7-4705-8669-b4e13bdac221 service nova] Creating event network-changed:45ea4fde-69bf-4651-956f-e265b3f4ca34 for instance 9d3e6518-0173-4f31-ba51-d3fe0f2980e0 on hv-cinder-81514 Aug 30 01:09:24.252227 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-111d4004-8c2d-4744-aa7e-27859b3a3153 req-13716ff4-c3a7-4705-8669-b4e13bdac221 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033415 Aug 30 01:09:24.252824 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 422/852] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:35.253930 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f3d6488e-3aff-4c0e-999e-ed77009cb758 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2117174702", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1664379396", "security_groups": [{"name": "tempest-secgroup-smoke-1990279540"}], "networks": [{"uuid": "975176e1-2963-4279-99b0-e91749d91c94"}], "block_device_mapping_v2": [{"uuid": "3df6b8ab-6ffd-4df6-a300-6c3c7bd841e8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:35.265238 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:35.266124 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=1 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:35.371462 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.network.neutron [None req-f3d6488e-3aff-4c0e-999e-ed77009cb758 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] validate_networks() for [('975176e1-2963-4279-99b0-e91749d91c94', None, None, None, None, None)] {{(pid=120630) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:09:35.755197 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-f3d6488e-3aff-4c0e-999e-ed77009cb758 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Flavor limits 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:09:35.755673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-f3d6488e-3aff-4c0e-999e-ed77009cb758 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Image limits 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:09:35.756199 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-f3d6488e-3aff-4c0e-999e-ed77009cb758 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Flavor pref 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:09:35.756615 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-f3d6488e-3aff-4c0e-999e-ed77009cb758 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Image pref 0:0:0 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:09:35.757090 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.virt.hardware [None req-f3d6488e-3aff-4c0e-999e-ed77009cb758 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:09:35.769740 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f3d6488e-3aff-4c0e-999e-ed77009cb758 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:35.770231 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f3d6488e-3aff-4c0e-999e-ed77009cb758 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:35.770668 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f3d6488e-3aff-4c0e-999e-ed77009cb758 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:35.771389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f3d6488e-3aff-4c0e-999e-ed77009cb758 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:35.771843 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f3d6488e-3aff-4c0e-999e-ed77009cb758 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:35.772265 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f3d6488e-3aff-4c0e-999e-ed77009cb758 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:35.789736 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-f3d6488e-3aff-4c0e-999e-ed77009cb758 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Getting quotas for project aa4d639296c34f1dbf0b327fd0828620. Resources: {'ram', 'instances', 'cores'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:09:35.794197 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-f3d6488e-3aff-4c0e-999e-ed77009cb758 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Getting quotas for user 21a84ede2a594f7ab23b442baa9f2f5a and project aa4d639296c34f1dbf0b327fd0828620. Resources: {'ram', 'instances', 'cores'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:09:35.855076 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-f3d6488e-3aff-4c0e-999e-ed77009cb758 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Going to run 1 instances... {{(pid=120630) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:09:35.857262 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-f3d6488e-3aff-4c0e-999e-ed77009cb758 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3df6b8ab-6ffd-4df6-a300-6c3c7bd841e8',volume_size=None,volume_type=None)] {{(pid=120630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:09:35.992575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-f3d6488e-3aff-4c0e-999e-ed77009cb758 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.742687 Aug 30 01:09:35.993366 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 431/853] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 30 01:09:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 01:09:36.002500 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:36.003288 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=7 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:36.007442 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-6f884b8b-129a-43c9-aae6-e741e34bdf97 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:36.008169 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-6f884b8b-129a-43c9-aae6-e741e34bdf97 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:36.069490 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6f884b8b-129a-43c9-aae6-e741e34bdf97 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:36.078048 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-6f884b8b-129a-43c9-aae6-e741e34bdf97 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1089 microversion: 2.1 time: 0.077224 Aug 30 01:09:36.078885 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 423/854] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:35 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1089 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:37.099635 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-dd43b0ba-7a66-4578-9ab2-6cdabc39b495 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:37.100185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-dd43b0ba-7a66-4578-9ab2-6cdabc39b495 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:37.106721 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dd43b0ba-7a66-4578-9ab2-6cdabc39b495 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:37.107197 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dd43b0ba-7a66-4578-9ab2-6cdabc39b495 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:37.107788 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dd43b0ba-7a66-4578-9ab2-6cdabc39b495 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:37.108474 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dd43b0ba-7a66-4578-9ab2-6cdabc39b495 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:37.109132 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dd43b0ba-7a66-4578-9ab2-6cdabc39b495 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:37.109608 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dd43b0ba-7a66-4578-9ab2-6cdabc39b495 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:37.173227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-dd43b0ba-7a66-4578-9ab2-6cdabc39b495 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:37.181748 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-dd43b0ba-7a66-4578-9ab2-6cdabc39b495 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1187 microversion: 2.1 time: 0.086326 Aug 30 01:09:37.182558 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 432/855] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:37 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:38.204538 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-9f8cfb86-95ae-4141-91e3-d4ed5400ef3e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:38.205822 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-9f8cfb86-95ae-4141-91e3-d4ed5400ef3e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:38.212828 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9f8cfb86-95ae-4141-91e3-d4ed5400ef3e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:38.213353 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9f8cfb86-95ae-4141-91e3-d4ed5400ef3e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:38.213793 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9f8cfb86-95ae-4141-91e3-d4ed5400ef3e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:38.214495 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9f8cfb86-95ae-4141-91e3-d4ed5400ef3e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:38.214953 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9f8cfb86-95ae-4141-91e3-d4ed5400ef3e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:38.215380 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9f8cfb86-95ae-4141-91e3-d4ed5400ef3e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:38.348911 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-9f8cfb86-95ae-4141-91e3-d4ed5400ef3e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:38.357740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-9f8cfb86-95ae-4141-91e3-d4ed5400ef3e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1261 microversion: 2.1 time: 0.157239 Aug 30 01:09:38.369164 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 424/856] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:38 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:38.573376 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-560bb325-cd93-4931-81fb-d5409f855ca1 req-006d4b2b-5c3a-4f5d-9ccf-ffcfa2213031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77c1fad5-fcbd-475a-b590-406d1b8cfc8f", "tag": "f326f1cc-3214-4c94-b458-a90b5f3ea1e3"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:38.586001 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-560bb325-cd93-4931-81fb-d5409f855ca1 req-006d4b2b-5c3a-4f5d-9ccf-ffcfa2213031 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:38.587110 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-560bb325-cd93-4931-81fb-d5409f855ca1 req-006d4b2b-5c3a-4f5d-9ccf-ffcfa2213031 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:38.587710 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-560bb325-cd93-4931-81fb-d5409f855ca1 req-006d4b2b-5c3a-4f5d-9ccf-ffcfa2213031 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:38.599852 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-560bb325-cd93-4931-81fb-d5409f855ca1 req-006d4b2b-5c3a-4f5d-9ccf-ffcfa2213031 service nova] Creating event network-changed:f326f1cc-3214-4c94-b458-a90b5f3ea1e3 for instance 77c1fad5-fcbd-475a-b590-406d1b8cfc8f on hv-cinder-81514 Aug 30 01:09:38.604709 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-560bb325-cd93-4931-81fb-d5409f855ca1 req-006d4b2b-5c3a-4f5d-9ccf-ffcfa2213031 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035621 Aug 30 01:09:38.605582 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 433/857] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:39.379480 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-78de19fb-a0cf-4d89-b13f-952e91d0e389 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:39.380097 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-78de19fb-a0cf-4d89-b13f-952e91d0e389 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:39.386606 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-78de19fb-a0cf-4d89-b13f-952e91d0e389 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:39.387293 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-78de19fb-a0cf-4d89-b13f-952e91d0e389 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:39.387735 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-78de19fb-a0cf-4d89-b13f-952e91d0e389 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:39.388476 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-78de19fb-a0cf-4d89-b13f-952e91d0e389 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:39.388933 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-78de19fb-a0cf-4d89-b13f-952e91d0e389 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:39.389392 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-78de19fb-a0cf-4d89-b13f-952e91d0e389 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:39.534045 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-78de19fb-a0cf-4d89-b13f-952e91d0e389 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:39.541722 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-78de19fb-a0cf-4d89-b13f-952e91d0e389 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1261 microversion: 2.1 time: 0.166195 Aug 30 01:09:39.542287 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 425/858] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:39 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:40.564597 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-d5e7aa61-77bb-4e76-83a6-1b363a70ecc3 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:40.565261 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-d5e7aa61-77bb-4e76-83a6-1b363a70ecc3 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:40.571364 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d5e7aa61-77bb-4e76-83a6-1b363a70ecc3 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:40.571859 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d5e7aa61-77bb-4e76-83a6-1b363a70ecc3 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:40.572283 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d5e7aa61-77bb-4e76-83a6-1b363a70ecc3 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:40.572966 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d5e7aa61-77bb-4e76-83a6-1b363a70ecc3 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:40.573451 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d5e7aa61-77bb-4e76-83a6-1b363a70ecc3 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:40.573879 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d5e7aa61-77bb-4e76-83a6-1b363a70ecc3 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:40.708245 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-d5e7aa61-77bb-4e76-83a6-1b363a70ecc3 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:40.716018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-d5e7aa61-77bb-4e76-83a6-1b363a70ecc3 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1261 microversion: 2.1 time: 0.156473 Aug 30 01:09:40.717139 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 434/859] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:40 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:41.738512 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-ada31715-a28f-4c56-a6ec-3565b843d2fb tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:41.739129 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-ada31715-a28f-4c56-a6ec-3565b843d2fb tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:41.745868 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ada31715-a28f-4c56-a6ec-3565b843d2fb tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:41.746353 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ada31715-a28f-4c56-a6ec-3565b843d2fb tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:41.746790 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ada31715-a28f-4c56-a6ec-3565b843d2fb tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:41.747480 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ada31715-a28f-4c56-a6ec-3565b843d2fb tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:41.748027 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ada31715-a28f-4c56-a6ec-3565b843d2fb tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:41.748510 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ada31715-a28f-4c56-a6ec-3565b843d2fb tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:41.878906 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-ada31715-a28f-4c56-a6ec-3565b843d2fb tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:41.886693 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-ada31715-a28f-4c56-a6ec-3565b843d2fb tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1261 microversion: 2.1 time: 0.152010 Aug 30 01:09:41.887266 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 426/860] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:41 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:42.908651 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-14bdacda-9099-481e-ba70-1c96d7c16fac tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:42.909291 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-14bdacda-9099-481e-ba70-1c96d7c16fac tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:42.915748 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-14bdacda-9099-481e-ba70-1c96d7c16fac tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:42.916226 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-14bdacda-9099-481e-ba70-1c96d7c16fac tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:42.916660 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-14bdacda-9099-481e-ba70-1c96d7c16fac tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:42.917372 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-14bdacda-9099-481e-ba70-1c96d7c16fac tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:42.917824 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-14bdacda-9099-481e-ba70-1c96d7c16fac tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:42.918247 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-14bdacda-9099-481e-ba70-1c96d7c16fac tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:43.050351 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-14bdacda-9099-481e-ba70-1c96d7c16fac tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:43.057934 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-14bdacda-9099-481e-ba70-1c96d7c16fac tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1261 microversion: 2.1 time: 0.153873 Aug 30 01:09:43.058496 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 435/861] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:42 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:44.080347 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0b65cde4-db9b-4440-9fbc-f455a70237c6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:44.080981 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-0b65cde4-db9b-4440-9fbc-f455a70237c6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:44.087544 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b65cde4-db9b-4440-9fbc-f455a70237c6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:44.087984 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b65cde4-db9b-4440-9fbc-f455a70237c6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:44.088405 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b65cde4-db9b-4440-9fbc-f455a70237c6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:44.089099 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b65cde4-db9b-4440-9fbc-f455a70237c6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:44.089565 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b65cde4-db9b-4440-9fbc-f455a70237c6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:44.090275 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0b65cde4-db9b-4440-9fbc-f455a70237c6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:44.221063 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-0b65cde4-db9b-4440-9fbc-f455a70237c6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:44.230167 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0b65cde4-db9b-4440-9fbc-f455a70237c6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1261 microversion: 2.1 time: 0.155225 Aug 30 01:09:44.230763 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 427/862] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:44 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:45.251297 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-cfae9342-3c92-4e68-a7c1-13dcf9a0e842 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:45.251874 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-cfae9342-3c92-4e68-a7c1-13dcf9a0e842 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:45.258543 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cfae9342-3c92-4e68-a7c1-13dcf9a0e842 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:45.259025 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cfae9342-3c92-4e68-a7c1-13dcf9a0e842 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:45.259461 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cfae9342-3c92-4e68-a7c1-13dcf9a0e842 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:45.260152 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cfae9342-3c92-4e68-a7c1-13dcf9a0e842 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:45.260608 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cfae9342-3c92-4e68-a7c1-13dcf9a0e842 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:45.261557 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cfae9342-3c92-4e68-a7c1-13dcf9a0e842 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:45.394288 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-cfae9342-3c92-4e68-a7c1-13dcf9a0e842 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:45.402152 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-cfae9342-3c92-4e68-a7c1-13dcf9a0e842 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1261 microversion: 2.1 time: 0.155610 Aug 30 01:09:45.402707 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 436/863] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:45 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:46.422566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-c852e5d8-2832-402a-a018-d434124f62fc tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:46.423176 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-c852e5d8-2832-402a-a018-d434124f62fc tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:46.425553 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=2 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:46.430887 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c852e5d8-2832-402a-a018-d434124f62fc tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:46.431363 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c852e5d8-2832-402a-a018-d434124f62fc tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:46.431795 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c852e5d8-2832-402a-a018-d434124f62fc tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:46.432474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c852e5d8-2832-402a-a018-d434124f62fc tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:46.432920 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c852e5d8-2832-402a-a018-d434124f62fc tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:46.433372 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c852e5d8-2832-402a-a018-d434124f62fc tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:46.563125 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-c852e5d8-2832-402a-a018-d434124f62fc tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:46.570742 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-c852e5d8-2832-402a-a018-d434124f62fc tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1261 microversion: 2.1 time: 0.152040 Aug 30 01:09:46.571304 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 428/864] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:46 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:47.592303 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-7c700059-944f-4ddc-997b-606ba71440ce tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:47.592907 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-7c700059-944f-4ddc-997b-606ba71440ce tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:47.594882 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=2 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:47.595543 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=6 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:47.601587 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c700059-944f-4ddc-997b-606ba71440ce tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:47.602075 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c700059-944f-4ddc-997b-606ba71440ce tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:47.602508 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c700059-944f-4ddc-997b-606ba71440ce tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:47.603201 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c700059-944f-4ddc-997b-606ba71440ce tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:47.603655 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c700059-944f-4ddc-997b-606ba71440ce tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:47.604081 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7c700059-944f-4ddc-997b-606ba71440ce tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:47.744781 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7c700059-944f-4ddc-997b-606ba71440ce tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:47.753506 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-7c700059-944f-4ddc-997b-606ba71440ce tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1261 microversion: 2.1 time: 0.166038 Aug 30 01:09:47.754284 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 437/865] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:47 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:48.774455 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-df8c236e-cd40-4a31-b144-246ea9942e9b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:48.775071 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-df8c236e-cd40-4a31-b144-246ea9942e9b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:48.782429 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-df8c236e-cd40-4a31-b144-246ea9942e9b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:48.782909 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-df8c236e-cd40-4a31-b144-246ea9942e9b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:48.783341 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-df8c236e-cd40-4a31-b144-246ea9942e9b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:48.784033 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-df8c236e-cd40-4a31-b144-246ea9942e9b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:48.784480 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-df8c236e-cd40-4a31-b144-246ea9942e9b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:48.784900 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-df8c236e-cd40-4a31-b144-246ea9942e9b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:48.914936 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-df8c236e-cd40-4a31-b144-246ea9942e9b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:48.923284 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-df8c236e-cd40-4a31-b144-246ea9942e9b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1261 microversion: 2.1 time: 0.152709 Aug 30 01:09:48.924048 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 429/866] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:48 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:49.943719 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-1d380afd-f2ed-4a00-ad72-3790dc2409e2 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:49.944331 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-1d380afd-f2ed-4a00-ad72-3790dc2409e2 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:49.952790 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1d380afd-f2ed-4a00-ad72-3790dc2409e2 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:49.953309 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1d380afd-f2ed-4a00-ad72-3790dc2409e2 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:49.953742 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1d380afd-f2ed-4a00-ad72-3790dc2409e2 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:49.954437 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1d380afd-f2ed-4a00-ad72-3790dc2409e2 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:49.954890 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1d380afd-f2ed-4a00-ad72-3790dc2409e2 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:49.955308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1d380afd-f2ed-4a00-ad72-3790dc2409e2 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:50.087361 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-1d380afd-f2ed-4a00-ad72-3790dc2409e2 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:50.095913 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-1d380afd-f2ed-4a00-ad72-3790dc2409e2 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1261 microversion: 2.1 time: 0.156023 Aug 30 01:09:50.096482 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 438/867] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:49 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:51.117799 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-74a480aa-58bb-434b-b32c-80c2705cdb8c tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:51.118370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-74a480aa-58bb-434b-b32c-80c2705cdb8c tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:51.125521 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-74a480aa-58bb-434b-b32c-80c2705cdb8c tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:51.126003 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-74a480aa-58bb-434b-b32c-80c2705cdb8c tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:51.126438 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-74a480aa-58bb-434b-b32c-80c2705cdb8c tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:51.127127 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-74a480aa-58bb-434b-b32c-80c2705cdb8c tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:51.127582 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-74a480aa-58bb-434b-b32c-80c2705cdb8c tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:51.128027 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-74a480aa-58bb-434b-b32c-80c2705cdb8c tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:51.258790 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-74a480aa-58bb-434b-b32c-80c2705cdb8c tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:51.266687 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-74a480aa-58bb-434b-b32c-80c2705cdb8c tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1261 microversion: 2.1 time: 0.152763 Aug 30 01:09:51.267257 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 430/868] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:51 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:52.287607 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-5106d7f6-7d45-45c4-93f4-614cccd5b97e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:52.288212 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-5106d7f6-7d45-45c4-93f4-614cccd5b97e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:52.294928 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5106d7f6-7d45-45c4-93f4-614cccd5b97e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:52.295410 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5106d7f6-7d45-45c4-93f4-614cccd5b97e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:52.295845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5106d7f6-7d45-45c4-93f4-614cccd5b97e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:52.296534 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5106d7f6-7d45-45c4-93f4-614cccd5b97e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:52.296984 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5106d7f6-7d45-45c4-93f4-614cccd5b97e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:52.297434 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5106d7f6-7d45-45c4-93f4-614cccd5b97e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:52.425775 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-5106d7f6-7d45-45c4-93f4-614cccd5b97e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:52.433297 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-5106d7f6-7d45-45c4-93f4-614cccd5b97e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1261 microversion: 2.1 time: 0.149512 Aug 30 01:09:52.433854 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 439/869] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:52 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:52.989798 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-44bf3225-de1c-44a9-a605-03e615bef00b req-fc9a0ff8-9070-4ba3-8b6e-c953bacd1f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c1fad5-fcbd-475a-b590-406d1b8cfc8f", "name": "network-vif-plugged", "status": "completed", "tag": "f326f1cc-3214-4c94-b458-a90b5f3ea1e3"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:53.001523 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-44bf3225-de1c-44a9-a605-03e615bef00b req-fc9a0ff8-9070-4ba3-8b6e-c953bacd1f65 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:53.001998 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-44bf3225-de1c-44a9-a605-03e615bef00b req-fc9a0ff8-9070-4ba3-8b6e-c953bacd1f65 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:53.002424 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-44bf3225-de1c-44a9-a605-03e615bef00b req-fc9a0ff8-9070-4ba3-8b6e-c953bacd1f65 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:53.014730 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-44bf3225-de1c-44a9-a605-03e615bef00b req-fc9a0ff8-9070-4ba3-8b6e-c953bacd1f65 service nova] Creating event network-vif-plugged:f326f1cc-3214-4c94-b458-a90b5f3ea1e3 for instance 77c1fad5-fcbd-475a-b590-406d1b8cfc8f on hv-cinder-81514 Aug 30 01:09:53.019718 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-44bf3225-de1c-44a9-a605-03e615bef00b req-fc9a0ff8-9070-4ba3-8b6e-c953bacd1f65 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035187 Aug 30 01:09:53.020465 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 431/870] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:53.453602 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-171b506f-99a4-45e3-ab0a-30fef31fb076 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:53.454250 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-171b506f-99a4-45e3-ab0a-30fef31fb076 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:53.460689 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-171b506f-99a4-45e3-ab0a-30fef31fb076 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:53.461211 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-171b506f-99a4-45e3-ab0a-30fef31fb076 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:53.461656 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-171b506f-99a4-45e3-ab0a-30fef31fb076 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:53.462352 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-171b506f-99a4-45e3-ab0a-30fef31fb076 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:53.462831 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-171b506f-99a4-45e3-ab0a-30fef31fb076 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:53.463262 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-171b506f-99a4-45e3-ab0a-30fef31fb076 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:53.598440 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-171b506f-99a4-45e3-ab0a-30fef31fb076 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:53.606110 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-171b506f-99a4-45e3-ab0a-30fef31fb076 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1261 microversion: 2.1 time: 0.156521 Aug 30 01:09:53.607178 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 440/871] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:53 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:54.627990 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-2bec28b9-cba6-43a8-920f-12477136614e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:54.628685 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-2bec28b9-cba6-43a8-920f-12477136614e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:54.634925 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2bec28b9-cba6-43a8-920f-12477136614e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:54.635407 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2bec28b9-cba6-43a8-920f-12477136614e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:54.635843 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2bec28b9-cba6-43a8-920f-12477136614e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:54.636528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2bec28b9-cba6-43a8-920f-12477136614e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:54.636981 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2bec28b9-cba6-43a8-920f-12477136614e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:54.637432 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2bec28b9-cba6-43a8-920f-12477136614e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:54.771903 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-2bec28b9-cba6-43a8-920f-12477136614e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:54.780428 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-2bec28b9-cba6-43a8-920f-12477136614e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1261 microversion: 2.1 time: 0.157121 Aug 30 01:09:54.780988 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 432/872] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:54 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:55.801455 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-7cfdae33-ddad-4a45-a98f-c82a8e18a43a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:55.803076 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-7cfdae33-ddad-4a45-a98f-c82a8e18a43a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:55.808011 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7cfdae33-ddad-4a45-a98f-c82a8e18a43a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:55.808491 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7cfdae33-ddad-4a45-a98f-c82a8e18a43a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:55.808920 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7cfdae33-ddad-4a45-a98f-c82a8e18a43a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:55.810305 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7cfdae33-ddad-4a45-a98f-c82a8e18a43a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:55.810753 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7cfdae33-ddad-4a45-a98f-c82a8e18a43a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:55.811175 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7cfdae33-ddad-4a45-a98f-c82a8e18a43a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:55.939356 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7cfdae33-ddad-4a45-a98f-c82a8e18a43a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:55.946979 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-7cfdae33-ddad-4a45-a98f-c82a8e18a43a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1444 microversion: 2.1 time: 0.149991 Aug 30 01:09:55.947542 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 441/873] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:55 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1444 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:55.967782 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-72adfc67-d56a-4159-a8ce-9f893b9bec85 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:55.968392 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-72adfc67-d56a-4159-a8ce-9f893b9bec85 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:55.974844 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-72adfc67-d56a-4159-a8ce-9f893b9bec85 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:55.975329 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-72adfc67-d56a-4159-a8ce-9f893b9bec85 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:55.975765 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-72adfc67-d56a-4159-a8ce-9f893b9bec85 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:55.976475 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-72adfc67-d56a-4159-a8ce-9f893b9bec85 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:55.976939 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-72adfc67-d56a-4159-a8ce-9f893b9bec85 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:55.977335 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-72adfc67-d56a-4159-a8ce-9f893b9bec85 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:56.120945 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-72adfc67-d56a-4159-a8ce-9f893b9bec85 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:56.128930 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-72adfc67-d56a-4159-a8ce-9f893b9bec85 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1444 microversion: 2.1 time: 0.165564 Aug 30 01:09:56.129530 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 433/874] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:55 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1444 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:58.149553 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-e03abd5b-d0ce-497d-8254-171a79a84917 req-2f3c6810-cd48-425b-a7c9-06d228f196c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77c1fad5-fcbd-475a-b590-406d1b8cfc8f", "tag": "f326f1cc-3214-4c94-b458-a90b5f3ea1e3"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:58.160351 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-e03abd5b-d0ce-497d-8254-171a79a84917 req-2f3c6810-cd48-425b-a7c9-06d228f196c0 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:58.160826 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-e03abd5b-d0ce-497d-8254-171a79a84917 req-2f3c6810-cd48-425b-a7c9-06d228f196c0 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:58.161282 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-e03abd5b-d0ce-497d-8254-171a79a84917 req-2f3c6810-cd48-425b-a7c9-06d228f196c0 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:58.172499 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-e03abd5b-d0ce-497d-8254-171a79a84917 req-2f3c6810-cd48-425b-a7c9-06d228f196c0 service nova] Creating event network-changed:f326f1cc-3214-4c94-b458-a90b5f3ea1e3 for instance 77c1fad5-fcbd-475a-b590-406d1b8cfc8f on hv-cinder-81514 Aug 30 01:09:58.177666 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-e03abd5b-d0ce-497d-8254-171a79a84917 req-2f3c6810-cd48-425b-a7c9-06d228f196c0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031812 Aug 30 01:09:58.178256 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 442/875] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:58.737640 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-63cbf993-3161-4614-b4ed-26f52b4cbfda tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:58.741891 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-63cbf993-3161-4614-b4ed-26f52b4cbfda tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:58.752083 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-63cbf993-3161-4614-b4ed-26f52b4cbfda tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:58.752858 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-63cbf993-3161-4614-b4ed-26f52b4cbfda tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:58.753526 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-63cbf993-3161-4614-b4ed-26f52b4cbfda tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:58.754430 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-63cbf993-3161-4614-b4ed-26f52b4cbfda tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:58.754880 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-63cbf993-3161-4614-b4ed-26f52b4cbfda tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:58.755309 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-63cbf993-3161-4614-b4ed-26f52b4cbfda tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:58.795416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-63cbf993-3161-4614-b4ed-26f52b4cbfda tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255/os-volume_attachments/7fd12643-9b86-4291-942c-418d93182c04" status: 200 len: 194 microversion: 2.20 time: 0.067005 Aug 30 01:09:58.801287 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 434/876] 10.222.0.78 () {60 vars in 1454 bytes} [Tue Aug 30 01:09:58 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255/os-volume_attachments/7fd12643-9b86-4291-942c-418d93182c04 => generated 194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 01:09:58.893046 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-98ae2aef-c151-4fa9-adb9-c3bb5628c897 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:58.893548 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-98ae2aef-c151-4fa9-adb9-c3bb5628c897 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:58.906290 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-98ae2aef-c151-4fa9-adb9-c3bb5628c897 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:58.906905 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-98ae2aef-c151-4fa9-adb9-c3bb5628c897 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:58.907488 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-98ae2aef-c151-4fa9-adb9-c3bb5628c897 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:58.908289 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-98ae2aef-c151-4fa9-adb9-c3bb5628c897 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:58.908935 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-98ae2aef-c151-4fa9-adb9-c3bb5628c897 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:58.909507 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-98ae2aef-c151-4fa9-adb9-c3bb5628c897 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:59.000920 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.objects.instance [None req-98ae2aef-c151-4fa9-adb9-c3bb5628c897 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lazy-loading 'services' on Instance uuid 8f9b5386-7fbc-4d22-a388-55c656bf9255 {{(pid=120630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:09:59.085224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-98ae2aef-c151-4fa9-adb9-c3bb5628c897 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255/os-volume_attachments/7fd12643-9b86-4291-942c-418d93182c04" status: 202 len: 0 microversion: 2.20 time: 0.196667 Aug 30 01:09:59.088982 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 443/877] 10.222.0.78 () {60 vars in 1457 bytes} [Tue Aug 30 01:09:58 2022] DELETE /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255/os-volume_attachments/7fd12643-9b86-4291-942c-418d93182c04 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 01:09:59.096847 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-eca83d40-fde8-42b3-aeaa-48c8b46af682 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:59.099109 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-eca83d40-fde8-42b3-aeaa-48c8b46af682 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:59.105518 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-eca83d40-fde8-42b3-aeaa-48c8b46af682 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:59.106251 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-eca83d40-fde8-42b3-aeaa-48c8b46af682 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:59.106901 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-eca83d40-fde8-42b3-aeaa-48c8b46af682 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:59.108015 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-eca83d40-fde8-42b3-aeaa-48c8b46af682 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:59.109115 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-eca83d40-fde8-42b3-aeaa-48c8b46af682 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:59.109652 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-eca83d40-fde8-42b3-aeaa-48c8b46af682 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:59.154783 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-eca83d40-fde8-42b3-aeaa-48c8b46af682 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064257 Aug 30 01:09:59.155688 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 435/878] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 30 01:09:59 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:10:00.169312 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-78d43246-bb02-46a5-a2ca-77d94058e5fd tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:00.171600 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-78d43246-bb02-46a5-a2ca-77d94058e5fd tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:10:00.177762 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-78d43246-bb02-46a5-a2ca-77d94058e5fd tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:00.178252 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-78d43246-bb02-46a5-a2ca-77d94058e5fd tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:00.178693 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-78d43246-bb02-46a5-a2ca-77d94058e5fd tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:00.179389 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-78d43246-bb02-46a5-a2ca-77d94058e5fd tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:00.179846 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-78d43246-bb02-46a5-a2ca-77d94058e5fd tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:00.180274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-78d43246-bb02-46a5-a2ca-77d94058e5fd tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:00.209030 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-78d43246-bb02-46a5-a2ca-77d94058e5fd tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044776 Aug 30 01:10:00.209624 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 444/879] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 30 01:10:00 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:10:00.271526 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-5b7597dc-92ca-4b4a-a9b1-ffed10116676 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:00.272031 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-5b7597dc-92ca-4b4a-a9b1-ffed10116676 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:10:00.279313 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5b7597dc-92ca-4b4a-a9b1-ffed10116676 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:00.279811 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5b7597dc-92ca-4b4a-a9b1-ffed10116676 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:00.280241 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5b7597dc-92ca-4b4a-a9b1-ffed10116676 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:00.280921 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5b7597dc-92ca-4b4a-a9b1-ffed10116676 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:00.281476 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5b7597dc-92ca-4b4a-a9b1-ffed10116676 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:00.281976 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5b7597dc-92ca-4b4a-a9b1-ffed10116676 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:00.306690 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-5b7597dc-92ca-4b4a-a9b1-ffed10116676 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Going to try to terminate instance {{(pid=120631) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:10:00.380157 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-5b7597dc-92ca-4b4a-a9b1-ffed10116676 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 204 len: 0 microversion: 2.20 time: 0.112252 Aug 30 01:10:00.380741 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 436/880] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 30 01:10:00 2022] DELETE /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 01:10:00.390028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-cac9c05e-9a1f-42b6-9b3a-f08c36cf9023 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:00.390692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-cac9c05e-9a1f-42b6-9b3a-f08c36cf9023 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:10:00.396535 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cac9c05e-9a1f-42b6-9b3a-f08c36cf9023 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:00.397007 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cac9c05e-9a1f-42b6-9b3a-f08c36cf9023 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:00.397486 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cac9c05e-9a1f-42b6-9b3a-f08c36cf9023 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:00.398174 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cac9c05e-9a1f-42b6-9b3a-f08c36cf9023 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:00.398626 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cac9c05e-9a1f-42b6-9b3a-f08c36cf9023 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:00.399048 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cac9c05e-9a1f-42b6-9b3a-f08c36cf9023 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:00.530122 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-cac9c05e-9a1f-42b6-9b3a-f08c36cf9023 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:00.538212 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-cac9c05e-9a1f-42b6-9b3a-f08c36cf9023 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:00.539661 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-cac9c05e-9a1f-42b6-9b3a-f08c36cf9023 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:00.540828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-cac9c05e-9a1f-42b6-9b3a-f08c36cf9023 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1722 microversion: 2.20 time: 0.155759 Aug 30 01:10:00.541455 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 445/881] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:10:00 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:10:01.565776 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-7bd41af9-e305-4367-9924-1093567c88b7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:01.566414 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-7bd41af9-e305-4367-9924-1093567c88b7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:10:01.572733 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7bd41af9-e305-4367-9924-1093567c88b7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:01.573260 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7bd41af9-e305-4367-9924-1093567c88b7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:01.573696 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7bd41af9-e305-4367-9924-1093567c88b7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:01.574389 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7bd41af9-e305-4367-9924-1093567c88b7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:01.574936 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7bd41af9-e305-4367-9924-1093567c88b7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:01.575363 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7bd41af9-e305-4367-9924-1093567c88b7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:01.702916 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-7bd41af9-e305-4367-9924-1093567c88b7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:01.710905 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-7bd41af9-e305-4367-9924-1093567c88b7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:01.712340 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-7bd41af9-e305-4367-9924-1093567c88b7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:01.713513 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-7bd41af9-e305-4367-9924-1093567c88b7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1722 microversion: 2.20 time: 0.152196 Aug 30 01:10:01.714074 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 437/882] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:10:01 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:10:02.737360 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-3711c346-dd4f-4417-b9e2-5d660d3643ff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:02.737976 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-3711c346-dd4f-4417-b9e2-5d660d3643ff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:10:02.744209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3711c346-dd4f-4417-b9e2-5d660d3643ff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:02.744702 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3711c346-dd4f-4417-b9e2-5d660d3643ff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:02.745205 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3711c346-dd4f-4417-b9e2-5d660d3643ff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:02.745904 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3711c346-dd4f-4417-b9e2-5d660d3643ff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:02.746677 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3711c346-dd4f-4417-b9e2-5d660d3643ff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:02.747124 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3711c346-dd4f-4417-b9e2-5d660d3643ff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:02.813872 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-3711c346-dd4f-4417-b9e2-5d660d3643ff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:02.822711 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-3711c346-dd4f-4417-b9e2-5d660d3643ff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:02.824244 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-3711c346-dd4f-4417-b9e2-5d660d3643ff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:02.825901 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-3711c346-dd4f-4417-b9e2-5d660d3643ff tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 200 len: 1655 microversion: 2.20 time: 0.092513 Aug 30 01:10:02.826808 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 446/883] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:10:02 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 1655 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:10:02.884320 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-e403adb5-3364-4811-bbb6-3403c9f1651d req-4c81271c-3656-4ee9-bc2e-b3ed14bb0532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9b5386-7fbc-4d22-a388-55c656bf9255", "name": "network-vif-deleted", "tag": "f87d3a77-05ed-43ac-b192-82ed7d858c40"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:10:02.896419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-e403adb5-3364-4811-bbb6-3403c9f1651d req-4c81271c-3656-4ee9-bc2e-b3ed14bb0532 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:02.896889 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-e403adb5-3364-4811-bbb6-3403c9f1651d req-4c81271c-3656-4ee9-bc2e-b3ed14bb0532 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:02.897436 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-e403adb5-3364-4811-bbb6-3403c9f1651d req-4c81271c-3656-4ee9-bc2e-b3ed14bb0532 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:02.909898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-e403adb5-3364-4811-bbb6-3403c9f1651d req-4c81271c-3656-4ee9-bc2e-b3ed14bb0532 service nova] Creating event network-vif-deleted:f87d3a77-05ed-43ac-b192-82ed7d858c40 for instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 on hv-cinder-81514 Aug 30 01:10:02.915318 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-e403adb5-3364-4811-bbb6-3403c9f1651d req-4c81271c-3656-4ee9-bc2e-b3ed14bb0532 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035243 Aug 30 01:10:02.916004 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 438/884] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:10:03.852273 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-294ecb07-5fdf-4afd-bd7f-2f247604d1db tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:03.852933 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-294ecb07-5fdf-4afd-bd7f-2f247604d1db tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:10:03.860279 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-294ecb07-5fdf-4afd-bd7f-2f247604d1db tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:03.860778 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-294ecb07-5fdf-4afd-bd7f-2f247604d1db tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:03.861275 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-294ecb07-5fdf-4afd-bd7f-2f247604d1db tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:03.861982 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-294ecb07-5fdf-4afd-bd7f-2f247604d1db tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:03.862513 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-294ecb07-5fdf-4afd-bd7f-2f247604d1db tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:03.862866 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-294ecb07-5fdf-4afd-bd7f-2f247604d1db tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:03.879333 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-294ecb07-5fdf-4afd-bd7f-2f247604d1db tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] HTTP exception thrown: Instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 could not be found. Aug 30 01:10:03.881018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-294ecb07-5fdf-4afd-bd7f-2f247604d1db tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Request method failure captured: Aug 30 01:10:03.881018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 HTTP/1.1 Aug 30 01:10:03.881018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:10:03.881018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:10:03.881018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:10:03.881018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:10:03.881018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:10:03.881018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:10:03.881018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:10:03.881018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:10:03.881018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWK2y6UJS-Sd2gnPMur0TECh3oo_ZLWf8EDLHuImTNankaCorLm0nFyp-S4lzxYn9lMlZ9QpLk1jIt4IQFA0MSHwXQMAn9LD9k50sfcGWLP44hfaSZxD1kJZfVgx_Er_zYODJAIRmb2VOWH7dy1A_oUtZXmbyKWob_y5YX379ER-q4o Aug 30 01:10:03.881018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:10:03.881018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:10:03.881018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:10:03.881018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:10:03.881018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:10:03.881018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:10:03.881018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:10:03.881018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: 54768b167b1c4fefb901f640203e1c5d Aug 30 01:10:03.881018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1193325301 Aug 30 01:10:03.881018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:10:03.881018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:10:03.884119 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_54768b167b1c4fefb901f640203e1c5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/54768b167b1c4fefb901f640203e1c5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/54768b167b1c4fefb901f640203e1c5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/54768b167b1c4fefb901f640203e1c5d"}]}] Aug 30 01:10:03.884119 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1193325301 Aug 30 01:10:03.884119 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: 54768b167b1c4fefb901f640203e1c5d Aug 30 01:10:03.884119 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1193325301 Aug 30 01:10:03.884119 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-AttachVolumeShelveTestJSON-1193325301-project Aug 30 01:10:03.884119 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:10:03.884119 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:10:03.884119 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: 3ff0c4a8fd8d44bda56ceeb47cd49abf Aug 30 01:10:03.884119 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1193325301-project Aug 30 01:10:03.884119 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:10:03.884119 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 could not be found. Aug 30 01:10:03.884119 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': '8f9b5386-7fbc-4d22-a388-55c656bf9255'} Aug 30 01:10:03.885733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:10:03.885733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:03.885733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:10:03.885733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:10:03.885733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:10:03.885733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:10:03.885733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:10:03.885733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:10:03.885733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:10:03.885733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:10:03.885733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 could not be found. Aug 30 01:10:03.885733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:10:03.885733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:10:03.885733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:10:03.885733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:03.885733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:10:03.885733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:10:03.885733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:10:03.885733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:10:03.885733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:10:03.889227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:10:03.889227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:10:03.889227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:10:03.889227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:10:03.889227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:10:03.889227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:10:03.889227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:10:03.889227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 could not be found. Aug 30 01:10:03.889227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:10:03.889227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:10:03.889227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:10:03.889227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:03.889227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:10:03.889227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:10:03.889227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:10:03.889227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:10:03.889227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 could not be found. Aug 30 01:10:03.889227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:10:03.891903 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-294ecb07-5fdf-4afd-bd7f-2f247604d1db tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Returning 404 to user: Instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:10:03.891903 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-294ecb07-5fdf-4afd-bd7f-2f247604d1db tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 404 len: 111 microversion: 2.20 time: 0.034347 Aug 30 01:10:03.891903 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 447/885] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:10:03 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:10:03.894701 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-f2ae1857-aa03-46b9-af1d-4cc539482a5c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '.version_select at 0x7f0f5266f160>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:03.921108 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-f2ae1857-aa03-46b9-af1d-4cc539482a5c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-690635282" status: 204 len: 0 microversion: 2.20 time: 0.031408 Aug 30 01:10:03.921692 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 439/886] 10.222.0.78 () {60 vars in 1259 bytes} [Tue Aug 30 01:10:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-690635282 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 01:10:04.552375 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-145b16b3-4878-4835-adff-2b71f718428a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Action: 'create', calling method: .version_select at 0x7f0f5253d9d0>, body: {"keypair": {"name": "tempest-keypair-1807294196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI2JifVgMnTEtwHxPAfEF5pUxfFI5745riYiQ/Ci13MyczqhbXA+yqHUAzMSWI4kARrW7j0NN/rjtCPHt5fgCZKeKhVWTgDiw/6bKDoCnUFQIfsCN5DsI1QB+DLA8vG6Q=="}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:10:04.568933 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-145b16b3-4878-4835-adff-2b71f718428a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Getting quotas for project 54768b167b1c4fefb901f640203e1c5d. Resources: {'key_pairs'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:10:04.572684 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.quota [None req-145b16b3-4878-4835-adff-2b71f718428a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Getting quotas for user 3ff0c4a8fd8d44bda56ceeb47cd49abf and project 54768b167b1c4fefb901f640203e1c5d. Resources: {'key_pairs'} {{(pid=120630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:10:04.584988 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR oslo.messaging._drivers.impl_rabbit [None req-145b16b3-4878-4835-adff-2b71f718428a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [1028e100-62a7-4b40-b1ed-cc2bbda71295] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 01:10:05.592687 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO oslo.messaging._drivers.impl_rabbit [None req-145b16b3-4878-4835-adff-2b71f718428a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [1028e100-62a7-4b40-b1ed-cc2bbda71295] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 57276. Aug 30 01:10:05.599044 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:05.609988 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-145b16b3-4878-4835-adff-2b71f718428a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.061499 Aug 30 01:10:05.610583 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 448/887] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Aug 30 01:10:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1063 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 30 01:10:06.917059 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-c84dabd2-0f2b-4bb9-a33c-1a88c4b0cef6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-811809868", "imageRef": "d6c817b5-c41c-4210-a963-172386e2e582", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "71657289-5845-4030-b5d1-5bad1153486f"}], "security_groups": [{"name": "tempest-securitygroup--862519577"}], "key_name": "tempest-keypair-1807294196", "user_data": "}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:10:06.926925 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:07.028124 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.network.neutron [None req-c84dabd2-0f2b-4bb9-a33c-1a88c4b0cef6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] validate_networks() for [('71657289-5845-4030-b5d1-5bad1153486f', None, None, None, None, None)] {{(pid=120631) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:10:07.402313 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-c84dabd2-0f2b-4bb9-a33c-1a88c4b0cef6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Flavor limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:10:07.402890 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-c84dabd2-0f2b-4bb9-a33c-1a88c4b0cef6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Image limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:10:07.403571 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-c84dabd2-0f2b-4bb9-a33c-1a88c4b0cef6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Flavor pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:10:07.403993 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-c84dabd2-0f2b-4bb9-a33c-1a88c4b0cef6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Image pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:10:07.404404 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-c84dabd2-0f2b-4bb9-a33c-1a88c4b0cef6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:10:07.413363 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c84dabd2-0f2b-4bb9-a33c-1a88c4b0cef6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:07.413845 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c84dabd2-0f2b-4bb9-a33c-1a88c4b0cef6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:07.414287 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c84dabd2-0f2b-4bb9-a33c-1a88c4b0cef6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:07.415015 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c84dabd2-0f2b-4bb9-a33c-1a88c4b0cef6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:07.415470 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c84dabd2-0f2b-4bb9-a33c-1a88c4b0cef6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:07.415890 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c84dabd2-0f2b-4bb9-a33c-1a88c4b0cef6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:07.422925 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:07.436416 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-c84dabd2-0f2b-4bb9-a33c-1a88c4b0cef6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Getting quotas for project 54768b167b1c4fefb901f640203e1c5d. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:10:07.440414 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-c84dabd2-0f2b-4bb9-a33c-1a88c4b0cef6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Getting quotas for user 3ff0c4a8fd8d44bda56ceeb47cd49abf and project 54768b167b1c4fefb901f640203e1c5d. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:10:07.452295 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-c84dabd2-0f2b-4bb9-a33c-1a88c4b0cef6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Going to run 1 instances... {{(pid=120631) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:10:07.454741 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-c84dabd2-0f2b-4bb9-a33c-1a88c4b0cef6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6c817b5-c41c-4210-a963-172386e2e582',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120631) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:10:07.507323 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-c84dabd2-0f2b-4bb9-a33c-1a88c4b0cef6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.594627 Aug 30 01:10:07.507892 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 440/888] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Aug 30 01:10:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 01:10:07.520422 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-0957bf3d-5ecb-4004-b105-4d015cb7c289 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:07.521028 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-0957bf3d-5ecb-4004-b105-4d015cb7c289 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:10:07.579153 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-0957bf3d-5ecb-4004-b105-4d015cb7c289 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:07.587432 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-0957bf3d-5ecb-4004-b105-4d015cb7c289 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:07.592376 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-0957bf3d-5ecb-4004-b105-4d015cb7c289 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:07.592376 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-0957bf3d-5ecb-4004-b105-4d015cb7c289 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1281 microversion: 2.20 time: 0.074492 Aug 30 01:10:07.592376 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 449/889] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:10:07 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:10:08.614067 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-7e400c20-1f4b-47d7-abee-60a3c4108687 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:08.614655 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-7e400c20-1f4b-47d7-abee-60a3c4108687 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:10:08.620920 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7e400c20-1f4b-47d7-abee-60a3c4108687 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:08.622068 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7e400c20-1f4b-47d7-abee-60a3c4108687 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:08.622500 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7e400c20-1f4b-47d7-abee-60a3c4108687 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:08.623205 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7e400c20-1f4b-47d7-abee-60a3c4108687 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:08.623653 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7e400c20-1f4b-47d7-abee-60a3c4108687 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:08.624072 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7e400c20-1f4b-47d7-abee-60a3c4108687 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:08.696277 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-7e400c20-1f4b-47d7-abee-60a3c4108687 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:08.707054 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-7e400c20-1f4b-47d7-abee-60a3c4108687 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:08.708568 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-7e400c20-1f4b-47d7-abee-60a3c4108687 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:08.709720 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-7e400c20-1f4b-47d7-abee-60a3c4108687 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1333 microversion: 2.20 time: 0.100167 Aug 30 01:10:08.710643 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 441/890] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:10:08 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1333 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:10:09.734063 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-695f3277-369e-4915-887a-1c63196d9794 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:09.734669 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-695f3277-369e-4915-887a-1c63196d9794 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:10:09.741405 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-695f3277-369e-4915-887a-1c63196d9794 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:09.741899 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-695f3277-369e-4915-887a-1c63196d9794 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:09.742336 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-695f3277-369e-4915-887a-1c63196d9794 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:09.743044 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-695f3277-369e-4915-887a-1c63196d9794 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:09.743554 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-695f3277-369e-4915-887a-1c63196d9794 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:09.743977 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-695f3277-369e-4915-887a-1c63196d9794 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:09.747021 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=1 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:09.892962 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-695f3277-369e-4915-887a-1c63196d9794 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:09.902013 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-695f3277-369e-4915-887a-1c63196d9794 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:09.904660 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-695f3277-369e-4915-887a-1c63196d9794 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:09.906442 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-695f3277-369e-4915-887a-1c63196d9794 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1406 microversion: 2.20 time: 0.176362 Aug 30 01:10:09.907779 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 450/891] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:10:09 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:10:10.094589 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-112dd286-b179-496f-910f-e0162939b06d req-18891614-3c27-49dc-b058-160621112a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7e7483-c8ec-40f2-814d-aba9573395ad", "tag": "729c26fe-a4b3-4cc3-b9e9-2603f916a1c4"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:10:10.107366 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-112dd286-b179-496f-910f-e0162939b06d req-18891614-3c27-49dc-b058-160621112a33 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:10.108148 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-112dd286-b179-496f-910f-e0162939b06d req-18891614-3c27-49dc-b058-160621112a33 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:10.108745 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-112dd286-b179-496f-910f-e0162939b06d req-18891614-3c27-49dc-b058-160621112a33 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:10.125649 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-112dd286-b179-496f-910f-e0162939b06d req-18891614-3c27-49dc-b058-160621112a33 service nova] Creating event network-changed:729c26fe-a4b3-4cc3-b9e9-2603f916a1c4 for instance aa7e7483-c8ec-40f2-814d-aba9573395ad on hv-cinder-81514 Aug 30 01:10:10.131448 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-112dd286-b179-496f-910f-e0162939b06d req-18891614-3c27-49dc-b058-160621112a33 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043950 Aug 30 01:10:10.132082 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 442/892] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:10:10.931309 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-3e33aff7-0d08-4ad6-b0f4-359f204d940c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:10.931907 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-3e33aff7-0d08-4ad6-b0f4-359f204d940c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:10:10.939471 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3e33aff7-0d08-4ad6-b0f4-359f204d940c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:10.939958 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3e33aff7-0d08-4ad6-b0f4-359f204d940c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:10.940398 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3e33aff7-0d08-4ad6-b0f4-359f204d940c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:10.941119 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3e33aff7-0d08-4ad6-b0f4-359f204d940c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:10.941578 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3e33aff7-0d08-4ad6-b0f4-359f204d940c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:10.942002 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3e33aff7-0d08-4ad6-b0f4-359f204d940c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:11.073225 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-3e33aff7-0d08-4ad6-b0f4-359f204d940c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:11.082198 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-3e33aff7-0d08-4ad6-b0f4-359f204d940c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:11.083654 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-3e33aff7-0d08-4ad6-b0f4-359f204d940c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:11.084783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-3e33aff7-0d08-4ad6-b0f4-359f204d940c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1406 microversion: 2.20 time: 0.157413 Aug 30 01:10:11.085372 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 451/893] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:10:10 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:10:12.108522 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-a2a06b4e-02fe-43b9-825e-11291be19c8b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:12.109324 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-a2a06b4e-02fe-43b9-825e-11291be19c8b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:10:12.116299 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a2a06b4e-02fe-43b9-825e-11291be19c8b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:12.116784 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a2a06b4e-02fe-43b9-825e-11291be19c8b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:12.117256 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a2a06b4e-02fe-43b9-825e-11291be19c8b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:12.117959 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a2a06b4e-02fe-43b9-825e-11291be19c8b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:12.118412 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a2a06b4e-02fe-43b9-825e-11291be19c8b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:12.118840 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a2a06b4e-02fe-43b9-825e-11291be19c8b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:12.254481 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-a2a06b4e-02fe-43b9-825e-11291be19c8b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:12.265929 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-a2a06b4e-02fe-43b9-825e-11291be19c8b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:12.267390 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-a2a06b4e-02fe-43b9-825e-11291be19c8b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:12.268523 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-a2a06b4e-02fe-43b9-825e-11291be19c8b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1406 microversion: 2.20 time: 0.164601 Aug 30 01:10:12.269316 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 443/894] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:10:12 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:10:13.292572 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-b50873f1-5f23-4b82-b196-e56455ad4b9c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:13.293304 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-b50873f1-5f23-4b82-b196-e56455ad4b9c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:10:13.299526 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b50873f1-5f23-4b82-b196-e56455ad4b9c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:13.300007 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b50873f1-5f23-4b82-b196-e56455ad4b9c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:13.300440 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b50873f1-5f23-4b82-b196-e56455ad4b9c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:13.301152 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b50873f1-5f23-4b82-b196-e56455ad4b9c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:13.301605 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b50873f1-5f23-4b82-b196-e56455ad4b9c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:13.302036 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b50873f1-5f23-4b82-b196-e56455ad4b9c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:13.436972 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-b50873f1-5f23-4b82-b196-e56455ad4b9c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:13.445086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-b50873f1-5f23-4b82-b196-e56455ad4b9c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:13.446586 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-b50873f1-5f23-4b82-b196-e56455ad4b9c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:13.447727 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-b50873f1-5f23-4b82-b196-e56455ad4b9c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1406 microversion: 2.20 time: 0.159863 Aug 30 01:10:13.448290 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 452/895] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:10:13 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:10:14.470475 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-97e96117-9712-41bf-8eeb-9d0d9d241718 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:14.471089 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-97e96117-9712-41bf-8eeb-9d0d9d241718 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:10:14.477692 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-97e96117-9712-41bf-8eeb-9d0d9d241718 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:14.478180 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-97e96117-9712-41bf-8eeb-9d0d9d241718 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:14.478619 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-97e96117-9712-41bf-8eeb-9d0d9d241718 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:14.479319 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-97e96117-9712-41bf-8eeb-9d0d9d241718 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:14.479771 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-97e96117-9712-41bf-8eeb-9d0d9d241718 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:14.480703 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-97e96117-9712-41bf-8eeb-9d0d9d241718 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:14.614148 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-97e96117-9712-41bf-8eeb-9d0d9d241718 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:14.623130 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-97e96117-9712-41bf-8eeb-9d0d9d241718 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:14.624696 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-97e96117-9712-41bf-8eeb-9d0d9d241718 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:14.625895 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-97e96117-9712-41bf-8eeb-9d0d9d241718 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1406 microversion: 2.20 time: 0.159356 Aug 30 01:10:14.626484 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 444/896] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:10:14 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:10:15.648741 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-56ca202f-182d-499c-a429-d2f65a55fe42 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:15.649563 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-56ca202f-182d-499c-a429-d2f65a55fe42 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:10:15.658132 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-56ca202f-182d-499c-a429-d2f65a55fe42 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:15.658617 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-56ca202f-182d-499c-a429-d2f65a55fe42 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:15.659063 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-56ca202f-182d-499c-a429-d2f65a55fe42 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:15.659758 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-56ca202f-182d-499c-a429-d2f65a55fe42 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:15.660224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-56ca202f-182d-499c-a429-d2f65a55fe42 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:15.660644 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-56ca202f-182d-499c-a429-d2f65a55fe42 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:15.798744 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-56ca202f-182d-499c-a429-d2f65a55fe42 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:15.807257 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-56ca202f-182d-499c-a429-d2f65a55fe42 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:15.809377 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-56ca202f-182d-499c-a429-d2f65a55fe42 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:15.810510 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-56ca202f-182d-499c-a429-d2f65a55fe42 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1406 microversion: 2.20 time: 0.166609 Aug 30 01:10:15.811095 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 453/897] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:10:15 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:10:16.832803 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-66af77ee-55d5-48c1-a9df-a7590875795e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:16.833455 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-66af77ee-55d5-48c1-a9df-a7590875795e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:10:16.840705 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-66af77ee-55d5-48c1-a9df-a7590875795e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:16.841217 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-66af77ee-55d5-48c1-a9df-a7590875795e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:16.842104 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-66af77ee-55d5-48c1-a9df-a7590875795e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:16.842355 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-66af77ee-55d5-48c1-a9df-a7590875795e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:16.842801 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-66af77ee-55d5-48c1-a9df-a7590875795e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:16.843220 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-66af77ee-55d5-48c1-a9df-a7590875795e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:16.975087 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-66af77ee-55d5-48c1-a9df-a7590875795e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:16.983488 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-66af77ee-55d5-48c1-a9df-a7590875795e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:16.984915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-66af77ee-55d5-48c1-a9df-a7590875795e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:16.986085 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-66af77ee-55d5-48c1-a9df-a7590875795e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1406 microversion: 2.20 time: 0.157145 Aug 30 01:10:16.986645 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 445/898] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:10:16 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:10:17.075876 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-9521c4a4-3466-4875-9eb8-9c91a1043188 req-49a53083-f3b7-4944-9584-ed418ef1fdea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7e7483-c8ec-40f2-814d-aba9573395ad", "name": "network-vif-plugged", "status": "completed", "tag": "729c26fe-a4b3-4cc3-b9e9-2603f916a1c4"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:10:17.093354 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-9521c4a4-3466-4875-9eb8-9c91a1043188 req-49a53083-f3b7-4944-9584-ed418ef1fdea service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:17.093856 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-9521c4a4-3466-4875-9eb8-9c91a1043188 req-49a53083-f3b7-4944-9584-ed418ef1fdea service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:17.094298 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-9521c4a4-3466-4875-9eb8-9c91a1043188 req-49a53083-f3b7-4944-9584-ed418ef1fdea service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:17.107686 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-9521c4a4-3466-4875-9eb8-9c91a1043188 req-49a53083-f3b7-4944-9584-ed418ef1fdea service nova] Creating event network-vif-plugged:729c26fe-a4b3-4cc3-b9e9-2603f916a1c4 for instance aa7e7483-c8ec-40f2-814d-aba9573395ad on hv-cinder-81514 Aug 30 01:10:17.113042 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-9521c4a4-3466-4875-9eb8-9c91a1043188 req-49a53083-f3b7-4944-9584-ed418ef1fdea service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041010 Aug 30 01:10:17.113747 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 454/899] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:10:18.009744 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-5a365878-2e44-430f-bcd6-499588292b3f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:18.010259 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-5a365878-2e44-430f-bcd6-499588292b3f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:10:18.012788 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=2 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:18.013449 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=6 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:18.019621 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5a365878-2e44-430f-bcd6-499588292b3f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:18.020100 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5a365878-2e44-430f-bcd6-499588292b3f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:18.020529 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5a365878-2e44-430f-bcd6-499588292b3f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:18.021248 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5a365878-2e44-430f-bcd6-499588292b3f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:18.021696 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5a365878-2e44-430f-bcd6-499588292b3f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:18.022117 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5a365878-2e44-430f-bcd6-499588292b3f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:18.153426 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-5a365878-2e44-430f-bcd6-499588292b3f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:18.161472 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-5a365878-2e44-430f-bcd6-499588292b3f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:18.162901 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-5a365878-2e44-430f-bcd6-499588292b3f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:18.164000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-5a365878-2e44-430f-bcd6-499588292b3f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1406 microversion: 2.20 time: 0.158222 Aug 30 01:10:18.164555 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 446/900] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:10:18 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:10:19.183999 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=6 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:19.188728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-59027783-68c5-46ff-8ee0-73764c91b395 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:19.189465 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-59027783-68c5-46ff-8ee0-73764c91b395 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:10:19.195961 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-59027783-68c5-46ff-8ee0-73764c91b395 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:19.196444 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-59027783-68c5-46ff-8ee0-73764c91b395 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:19.196879 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-59027783-68c5-46ff-8ee0-73764c91b395 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:19.197607 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-59027783-68c5-46ff-8ee0-73764c91b395 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:19.198059 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-59027783-68c5-46ff-8ee0-73764c91b395 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:19.198491 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-59027783-68c5-46ff-8ee0-73764c91b395 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:19.334191 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-59027783-68c5-46ff-8ee0-73764c91b395 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:19.342897 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-59027783-68c5-46ff-8ee0-73764c91b395 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:19.344350 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-59027783-68c5-46ff-8ee0-73764c91b395 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:19.345550 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-59027783-68c5-46ff-8ee0-73764c91b395 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1598 microversion: 2.20 time: 0.163236 Aug 30 01:10:19.346115 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 455/901] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:10:19 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:10:19.367557 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-a8598bb7-5183-4bde-98da-0f4b802db0d7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:19.368085 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-a8598bb7-5183-4bde-98da-0f4b802db0d7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:10:19.375167 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a8598bb7-5183-4bde-98da-0f4b802db0d7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:19.375652 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a8598bb7-5183-4bde-98da-0f4b802db0d7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:19.376096 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a8598bb7-5183-4bde-98da-0f4b802db0d7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:19.376793 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a8598bb7-5183-4bde-98da-0f4b802db0d7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:19.377287 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a8598bb7-5183-4bde-98da-0f4b802db0d7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:19.377717 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a8598bb7-5183-4bde-98da-0f4b802db0d7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:19.457870 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-a8598bb7-5183-4bde-98da-0f4b802db0d7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094153 Aug 30 01:10:19.458459 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 447/902] 10.222.0.78 () {60 vars in 1316 bytes} [Tue Aug 30 01:10:19 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:10:20.426566 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-406d9191-dfc7-4b21-9813-e175cbce5082 req-59bdeb07-0c53-4df7-ae59-2f1372a4fa6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7e7483-c8ec-40f2-814d-aba9573395ad", "tag": "729c26fe-a4b3-4cc3-b9e9-2603f916a1c4"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:10:20.437416 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-406d9191-dfc7-4b21-9813-e175cbce5082 req-59bdeb07-0c53-4df7-ae59-2f1372a4fa6c service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:20.437904 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-406d9191-dfc7-4b21-9813-e175cbce5082 req-59bdeb07-0c53-4df7-ae59-2f1372a4fa6c service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:20.438358 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-406d9191-dfc7-4b21-9813-e175cbce5082 req-59bdeb07-0c53-4df7-ae59-2f1372a4fa6c service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:20.449780 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-406d9191-dfc7-4b21-9813-e175cbce5082 req-59bdeb07-0c53-4df7-ae59-2f1372a4fa6c service nova] Creating event network-changed:729c26fe-a4b3-4cc3-b9e9-2603f916a1c4 for instance aa7e7483-c8ec-40f2-814d-aba9573395ad on hv-cinder-81514 Aug 30 01:10:20.454928 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-406d9191-dfc7-4b21-9813-e175cbce5082 req-59bdeb07-0c53-4df7-ae59-2f1372a4fa6c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032054 Aug 30 01:10:20.455524 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 456/903] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:10:56.405217 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:56.405965 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=37 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:56.409986 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0aff6e23-3c50-418e-a0b6-a5f58496bb6c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:56.410485 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-0aff6e23-3c50-418e-a0b6-a5f58496bb6c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:10:56.418370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0aff6e23-3c50-418e-a0b6-a5f58496bb6c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:56.418848 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0aff6e23-3c50-418e-a0b6-a5f58496bb6c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:56.419277 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0aff6e23-3c50-418e-a0b6-a5f58496bb6c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:56.419970 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0aff6e23-3c50-418e-a0b6-a5f58496bb6c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:56.420417 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0aff6e23-3c50-418e-a0b6-a5f58496bb6c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:56.420836 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0aff6e23-3c50-418e-a0b6-a5f58496bb6c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:56.444512 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0aff6e23-3c50-418e-a0b6-a5f58496bb6c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad/ips" status: 200 len: 151 microversion: 2.20 time: 0.040819 Aug 30 01:10:56.445069 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 448/904] 10.222.0.78 () {60 vars in 1289 bytes} [Tue Aug 30 01:10:56 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:10:58.489733 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=18 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:58.490477 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=33 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:58.496111 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-60fd7fe6-e22b-47a9-9779-b72b17b9335c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:10:58.496749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-60fd7fe6-e22b-47a9-9779-b72b17b9335c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:10:58.503994 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-60fd7fe6-e22b-47a9-9779-b72b17b9335c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:58.504516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-60fd7fe6-e22b-47a9-9779-b72b17b9335c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:58.504990 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-60fd7fe6-e22b-47a9-9779-b72b17b9335c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:58.505756 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-60fd7fe6-e22b-47a9-9779-b72b17b9335c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:58.506210 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-60fd7fe6-e22b-47a9-9779-b72b17b9335c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:58.506636 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-60fd7fe6-e22b-47a9-9779-b72b17b9335c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:58.531956 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.objects.instance [None req-60fd7fe6-e22b-47a9-9779-b72b17b9335c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lazy-loading 'flavor' on Instance uuid aa7e7483-c8ec-40f2-814d-aba9573395ad {{(pid=120630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:10:58.714458 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-60fd7fe6-e22b-47a9-9779-b72b17b9335c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "POST /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad/action" status: 202 len: 0 microversion: 2.20 time: 0.226314 Aug 30 01:10:58.715289 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 457/905] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Aug 30 01:10:58 2022] POST /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:10:58.723419 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3e388f11-3702-4dde-a857-8c6383dd02f3 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:58.724158 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-3e388f11-3702-4dde-a857-8c6383dd02f3 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:10:58.731659 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3e388f11-3702-4dde-a857-8c6383dd02f3 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:58.732177 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3e388f11-3702-4dde-a857-8c6383dd02f3 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:58.732610 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3e388f11-3702-4dde-a857-8c6383dd02f3 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:58.733351 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3e388f11-3702-4dde-a857-8c6383dd02f3 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:58.733796 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3e388f11-3702-4dde-a857-8c6383dd02f3 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:58.734213 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3e388f11-3702-4dde-a857-8c6383dd02f3 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:58.868719 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3e388f11-3702-4dde-a857-8c6383dd02f3 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:58.877201 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3e388f11-3702-4dde-a857-8c6383dd02f3 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:58.878651 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3e388f11-3702-4dde-a857-8c6383dd02f3 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:10:58.879807 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3e388f11-3702-4dde-a857-8c6383dd02f3 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1722 microversion: 2.20 time: 0.160344 Aug 30 01:10:58.880371 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 449/906] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:10:58 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:10:59.904437 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-1ef1336a-7e14-4407-bde6-4b585fd018eb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:59.905137 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-1ef1336a-7e14-4407-bde6-4b585fd018eb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:10:59.911434 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1ef1336a-7e14-4407-bde6-4b585fd018eb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:59.911916 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1ef1336a-7e14-4407-bde6-4b585fd018eb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:59.912349 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1ef1336a-7e14-4407-bde6-4b585fd018eb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:59.913034 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1ef1336a-7e14-4407-bde6-4b585fd018eb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:59.913508 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1ef1336a-7e14-4407-bde6-4b585fd018eb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:59.913933 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1ef1336a-7e14-4407-bde6-4b585fd018eb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:00.044565 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-1ef1336a-7e14-4407-bde6-4b585fd018eb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:00.052666 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-1ef1336a-7e14-4407-bde6-4b585fd018eb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:00.054164 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-1ef1336a-7e14-4407-bde6-4b585fd018eb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:00.055337 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-1ef1336a-7e14-4407-bde6-4b585fd018eb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1722 microversion: 2.20 time: 0.155832 Aug 30 01:11:00.055898 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 458/907] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:10:59 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:01.078818 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-299fe4de-7552-4bbb-8ea6-36b7af3d81f6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:01.079458 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-299fe4de-7552-4bbb-8ea6-36b7af3d81f6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:01.085873 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-299fe4de-7552-4bbb-8ea6-36b7af3d81f6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:01.086354 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-299fe4de-7552-4bbb-8ea6-36b7af3d81f6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:01.086789 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-299fe4de-7552-4bbb-8ea6-36b7af3d81f6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:01.087478 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-299fe4de-7552-4bbb-8ea6-36b7af3d81f6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:01.088203 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-299fe4de-7552-4bbb-8ea6-36b7af3d81f6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:01.088631 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-299fe4de-7552-4bbb-8ea6-36b7af3d81f6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:01.217301 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-299fe4de-7552-4bbb-8ea6-36b7af3d81f6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:01.225321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-299fe4de-7552-4bbb-8ea6-36b7af3d81f6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:01.226775 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-299fe4de-7552-4bbb-8ea6-36b7af3d81f6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:01.227938 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-299fe4de-7552-4bbb-8ea6-36b7af3d81f6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1722 microversion: 2.20 time: 0.153081 Aug 30 01:11:01.229034 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 450/908] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:01 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:02.251223 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4de90092-3957-4567-8a8b-c3efbf33fdb0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:02.251827 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-4de90092-3957-4567-8a8b-c3efbf33fdb0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:02.258103 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4de90092-3957-4567-8a8b-c3efbf33fdb0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:02.258590 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4de90092-3957-4567-8a8b-c3efbf33fdb0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:02.259032 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4de90092-3957-4567-8a8b-c3efbf33fdb0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:02.260238 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4de90092-3957-4567-8a8b-c3efbf33fdb0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:02.260728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4de90092-3957-4567-8a8b-c3efbf33fdb0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:02.261182 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4de90092-3957-4567-8a8b-c3efbf33fdb0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:02.390407 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-4de90092-3957-4567-8a8b-c3efbf33fdb0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:02.398686 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-4de90092-3957-4567-8a8b-c3efbf33fdb0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:02.400126 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-4de90092-3957-4567-8a8b-c3efbf33fdb0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:02.401311 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-4de90092-3957-4567-8a8b-c3efbf33fdb0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1722 microversion: 2.20 time: 0.154236 Aug 30 01:11:02.401872 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 459/909] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:02 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:03.425156 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-9b7ea968-a61d-40d5-b3e7-f1d8f5a77eb8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:03.425767 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-9b7ea968-a61d-40d5-b3e7-f1d8f5a77eb8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:03.432781 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9b7ea968-a61d-40d5-b3e7-f1d8f5a77eb8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:03.433339 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9b7ea968-a61d-40d5-b3e7-f1d8f5a77eb8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:03.433774 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9b7ea968-a61d-40d5-b3e7-f1d8f5a77eb8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:03.434465 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9b7ea968-a61d-40d5-b3e7-f1d8f5a77eb8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:03.434917 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9b7ea968-a61d-40d5-b3e7-f1d8f5a77eb8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:03.435342 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9b7ea968-a61d-40d5-b3e7-f1d8f5a77eb8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:03.565671 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-9b7ea968-a61d-40d5-b3e7-f1d8f5a77eb8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:03.574262 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-9b7ea968-a61d-40d5-b3e7-f1d8f5a77eb8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:03.575691 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-9b7ea968-a61d-40d5-b3e7-f1d8f5a77eb8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:03.576844 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-9b7ea968-a61d-40d5-b3e7-f1d8f5a77eb8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1722 microversion: 2.20 time: 0.155747 Aug 30 01:11:03.577500 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 451/910] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:03 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:04.600048 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-c0eed130-8b33-4e2d-be9a-3af9e1e1a610 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:04.600600 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-c0eed130-8b33-4e2d-be9a-3af9e1e1a610 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:04.607712 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c0eed130-8b33-4e2d-be9a-3af9e1e1a610 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:04.608191 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c0eed130-8b33-4e2d-be9a-3af9e1e1a610 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:04.608630 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c0eed130-8b33-4e2d-be9a-3af9e1e1a610 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:04.609339 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c0eed130-8b33-4e2d-be9a-3af9e1e1a610 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:04.609784 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c0eed130-8b33-4e2d-be9a-3af9e1e1a610 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:04.610204 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c0eed130-8b33-4e2d-be9a-3af9e1e1a610 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:04.746485 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-c0eed130-8b33-4e2d-be9a-3af9e1e1a610 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:04.754620 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-c0eed130-8b33-4e2d-be9a-3af9e1e1a610 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:04.756366 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-c0eed130-8b33-4e2d-be9a-3af9e1e1a610 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:04.757305 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-c0eed130-8b33-4e2d-be9a-3af9e1e1a610 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1722 microversion: 2.20 time: 0.161186 Aug 30 01:11:04.758060 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 460/911] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:04 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:05.781649 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-1f3f4077-edc9-48ae-8c5b-30953d774e78 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:05.782296 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-1f3f4077-edc9-48ae-8c5b-30953d774e78 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:05.788422 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f3f4077-edc9-48ae-8c5b-30953d774e78 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:05.788905 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f3f4077-edc9-48ae-8c5b-30953d774e78 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:05.789384 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f3f4077-edc9-48ae-8c5b-30953d774e78 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:05.790071 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f3f4077-edc9-48ae-8c5b-30953d774e78 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:05.790522 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f3f4077-edc9-48ae-8c5b-30953d774e78 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:05.791480 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f3f4077-edc9-48ae-8c5b-30953d774e78 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:05.922009 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-1f3f4077-edc9-48ae-8c5b-30953d774e78 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:05.929908 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-1f3f4077-edc9-48ae-8c5b-30953d774e78 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:05.931349 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-1f3f4077-edc9-48ae-8c5b-30953d774e78 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:05.932498 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-1f3f4077-edc9-48ae-8c5b-30953d774e78 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1722 microversion: 2.20 time: 0.154819 Aug 30 01:11:05.933061 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 452/912] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:05 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:11:06.955908 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-e4c497f3-1808-44a3-b955-0b8321dfeb12 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:06.956464 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-e4c497f3-1808-44a3-b955-0b8321dfeb12 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:06.962802 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e4c497f3-1808-44a3-b955-0b8321dfeb12 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:06.963282 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e4c497f3-1808-44a3-b955-0b8321dfeb12 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:06.963717 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e4c497f3-1808-44a3-b955-0b8321dfeb12 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:06.964479 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e4c497f3-1808-44a3-b955-0b8321dfeb12 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:06.965030 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e4c497f3-1808-44a3-b955-0b8321dfeb12 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:06.965478 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e4c497f3-1808-44a3-b955-0b8321dfeb12 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:07.095591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-e4c497f3-1808-44a3-b955-0b8321dfeb12 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:07.103725 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-e4c497f3-1808-44a3-b955-0b8321dfeb12 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:07.105922 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-e4c497f3-1808-44a3-b955-0b8321dfeb12 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:07.107105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-e4c497f3-1808-44a3-b955-0b8321dfeb12 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1722 microversion: 2.20 time: 0.155209 Aug 30 01:11:07.107667 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 461/913] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:06 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:08.131205 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-f5a42a13-0418-4776-88a7-9f5cd574c19c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:08.131839 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-f5a42a13-0418-4776-88a7-9f5cd574c19c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:08.139183 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f5a42a13-0418-4776-88a7-9f5cd574c19c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:08.139664 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f5a42a13-0418-4776-88a7-9f5cd574c19c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:08.140099 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f5a42a13-0418-4776-88a7-9f5cd574c19c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:08.140790 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f5a42a13-0418-4776-88a7-9f5cd574c19c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:08.141272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f5a42a13-0418-4776-88a7-9f5cd574c19c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:08.141703 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f5a42a13-0418-4776-88a7-9f5cd574c19c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:08.277466 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-f5a42a13-0418-4776-88a7-9f5cd574c19c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:08.285464 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-f5a42a13-0418-4776-88a7-9f5cd574c19c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:08.286909 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-f5a42a13-0418-4776-88a7-9f5cd574c19c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:08.288066 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-f5a42a13-0418-4776-88a7-9f5cd574c19c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1722 microversion: 2.20 time: 0.160772 Aug 30 01:11:08.288673 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 453/914] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:08 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:09.311219 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-fc170cdf-7d82-4dd6-8fa0-831c7d0915da tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:09.311850 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-fc170cdf-7d82-4dd6-8fa0-831c7d0915da tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:09.318422 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fc170cdf-7d82-4dd6-8fa0-831c7d0915da tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:09.318905 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fc170cdf-7d82-4dd6-8fa0-831c7d0915da tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:09.319343 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fc170cdf-7d82-4dd6-8fa0-831c7d0915da tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:09.320032 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fc170cdf-7d82-4dd6-8fa0-831c7d0915da tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:09.320483 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fc170cdf-7d82-4dd6-8fa0-831c7d0915da tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:09.320910 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fc170cdf-7d82-4dd6-8fa0-831c7d0915da tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:09.456483 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-fc170cdf-7d82-4dd6-8fa0-831c7d0915da tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:09.465574 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-fc170cdf-7d82-4dd6-8fa0-831c7d0915da tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:09.467030 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-fc170cdf-7d82-4dd6-8fa0-831c7d0915da tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:09.468237 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-fc170cdf-7d82-4dd6-8fa0-831c7d0915da tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1743 microversion: 2.20 time: 0.161311 Aug 30 01:11:09.468822 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 462/915] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:09 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:10.491490 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-2dcdc521-f3e4-41a7-a86f-456c4a8b27de tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:10.492098 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-2dcdc521-f3e4-41a7-a86f-456c4a8b27de tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:10.499727 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2dcdc521-f3e4-41a7-a86f-456c4a8b27de tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:10.500477 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2dcdc521-f3e4-41a7-a86f-456c4a8b27de tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:10.501259 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2dcdc521-f3e4-41a7-a86f-456c4a8b27de tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:10.502421 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2dcdc521-f3e4-41a7-a86f-456c4a8b27de tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:10.503355 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2dcdc521-f3e4-41a7-a86f-456c4a8b27de tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:10.504058 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-2dcdc521-f3e4-41a7-a86f-456c4a8b27de tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:10.836790 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-2dcdc521-f3e4-41a7-a86f-456c4a8b27de tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:10.845283 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-2dcdc521-f3e4-41a7-a86f-456c4a8b27de tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:10.846732 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-2dcdc521-f3e4-41a7-a86f-456c4a8b27de tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:10.847899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-2dcdc521-f3e4-41a7-a86f-456c4a8b27de tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1743 microversion: 2.20 time: 0.360560 Aug 30 01:11:10.848462 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 454/916] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:10 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1743 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:11.872080 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-b42e0708-0a9f-48bd-a717-6f6d367dfcf4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:11.872699 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-b42e0708-0a9f-48bd-a717-6f6d367dfcf4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:11.879594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b42e0708-0a9f-48bd-a717-6f6d367dfcf4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:11.880107 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b42e0708-0a9f-48bd-a717-6f6d367dfcf4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:11.880751 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b42e0708-0a9f-48bd-a717-6f6d367dfcf4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:11.881473 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b42e0708-0a9f-48bd-a717-6f6d367dfcf4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:11.882079 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b42e0708-0a9f-48bd-a717-6f6d367dfcf4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:11.882658 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b42e0708-0a9f-48bd-a717-6f6d367dfcf4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:12.024822 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-b42e0708-0a9f-48bd-a717-6f6d367dfcf4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:12.034714 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-b42e0708-0a9f-48bd-a717-6f6d367dfcf4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:12.036185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-b42e0708-0a9f-48bd-a717-6f6d367dfcf4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:12.037417 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-b42e0708-0a9f-48bd-a717-6f6d367dfcf4 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1738 microversion: 2.20 time: 0.169458 Aug 30 01:11:12.037979 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 463/917] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:11 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:13.062274 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-fbc5acee-1ee1-44e4-918b-34fecb086bc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:13.062881 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-fbc5acee-1ee1-44e4-918b-34fecb086bc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:13.070147 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fbc5acee-1ee1-44e4-918b-34fecb086bc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:13.070503 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fbc5acee-1ee1-44e4-918b-34fecb086bc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:13.071136 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fbc5acee-1ee1-44e4-918b-34fecb086bc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:13.071836 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fbc5acee-1ee1-44e4-918b-34fecb086bc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:13.072287 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fbc5acee-1ee1-44e4-918b-34fecb086bc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:13.072709 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fbc5acee-1ee1-44e4-918b-34fecb086bc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:13.213866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-fbc5acee-1ee1-44e4-918b-34fecb086bc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:13.233951 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-fbc5acee-1ee1-44e4-918b-34fecb086bc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:13.235384 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-fbc5acee-1ee1-44e4-918b-34fecb086bc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:13.236561 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-fbc5acee-1ee1-44e4-918b-34fecb086bc6 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1738 microversion: 2.20 time: 0.179004 Aug 30 01:11:13.237142 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 455/918] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:13 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:11:13.462848 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-47c90239-31cd-4df9-8122-f4d501292abd req-ef0e8bdc-94c4-4f42-bffe-38c3ee484a18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7e7483-c8ec-40f2-814d-aba9573395ad", "name": "network-vif-plugged", "status": "completed", "tag": "729c26fe-a4b3-4cc3-b9e9-2603f916a1c4"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:13.477842 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-47c90239-31cd-4df9-8122-f4d501292abd req-ef0e8bdc-94c4-4f42-bffe-38c3ee484a18 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:13.478836 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-47c90239-31cd-4df9-8122-f4d501292abd req-ef0e8bdc-94c4-4f42-bffe-38c3ee484a18 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:13.480098 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-47c90239-31cd-4df9-8122-f4d501292abd req-ef0e8bdc-94c4-4f42-bffe-38c3ee484a18 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:13.498234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-47c90239-31cd-4df9-8122-f4d501292abd req-ef0e8bdc-94c4-4f42-bffe-38c3ee484a18 service nova] Creating event network-vif-plugged:729c26fe-a4b3-4cc3-b9e9-2603f916a1c4 for instance aa7e7483-c8ec-40f2-814d-aba9573395ad on hv-cinder-81514 Aug 30 01:11:13.504005 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-47c90239-31cd-4df9-8122-f4d501292abd req-ef0e8bdc-94c4-4f42-bffe-38c3ee484a18 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044739 Aug 30 01:11:13.505324 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 464/919] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:11:14.267366 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-f7a39797-efc2-4807-9c7a-021214da6ddf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:14.271568 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-f7a39797-efc2-4807-9c7a-021214da6ddf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:14.285635 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f7a39797-efc2-4807-9c7a-021214da6ddf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:14.286379 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f7a39797-efc2-4807-9c7a-021214da6ddf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:14.287003 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f7a39797-efc2-4807-9c7a-021214da6ddf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:14.287936 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f7a39797-efc2-4807-9c7a-021214da6ddf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:14.288574 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f7a39797-efc2-4807-9c7a-021214da6ddf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:14.289205 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f7a39797-efc2-4807-9c7a-021214da6ddf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:14.456161 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-f7a39797-efc2-4807-9c7a-021214da6ddf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:14.468327 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-f7a39797-efc2-4807-9c7a-021214da6ddf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:14.470172 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-f7a39797-efc2-4807-9c7a-021214da6ddf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:14.471370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-f7a39797-efc2-4807-9c7a-021214da6ddf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1738 microversion: 2.20 time: 0.213524 Aug 30 01:11:14.471929 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 456/920] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:14 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:15.496594 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-b3c40400-6cd1-41b5-8965-658c3b19a7bc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:15.498077 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-b3c40400-6cd1-41b5-8965-658c3b19a7bc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:15.509344 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b3c40400-6cd1-41b5-8965-658c3b19a7bc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:15.510192 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b3c40400-6cd1-41b5-8965-658c3b19a7bc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:15.511109 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b3c40400-6cd1-41b5-8965-658c3b19a7bc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:15.511825 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b3c40400-6cd1-41b5-8965-658c3b19a7bc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:15.512276 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b3c40400-6cd1-41b5-8965-658c3b19a7bc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:15.512885 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b3c40400-6cd1-41b5-8965-658c3b19a7bc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:15.717583 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-b3c40400-6cd1-41b5-8965-658c3b19a7bc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:15.727593 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-b3c40400-6cd1-41b5-8965-658c3b19a7bc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:15.729047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-b3c40400-6cd1-41b5-8965-658c3b19a7bc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:15.730410 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-b3c40400-6cd1-41b5-8965-658c3b19a7bc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1738 microversion: 2.20 time: 0.239417 Aug 30 01:11:15.730966 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 465/921] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:15 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:16.759105 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-fd3b00d7-37e5-4476-be9d-66ca34981dbb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:16.759740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-fd3b00d7-37e5-4476-be9d-66ca34981dbb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:16.772801 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fd3b00d7-37e5-4476-be9d-66ca34981dbb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:16.773640 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fd3b00d7-37e5-4476-be9d-66ca34981dbb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:16.774273 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fd3b00d7-37e5-4476-be9d-66ca34981dbb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:16.775449 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fd3b00d7-37e5-4476-be9d-66ca34981dbb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:16.777367 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fd3b00d7-37e5-4476-be9d-66ca34981dbb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:16.778737 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-fd3b00d7-37e5-4476-be9d-66ca34981dbb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:16.963024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-fd3b00d7-37e5-4476-be9d-66ca34981dbb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:16.990194 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-fd3b00d7-37e5-4476-be9d-66ca34981dbb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:16.992012 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-fd3b00d7-37e5-4476-be9d-66ca34981dbb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:16.993320 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-fd3b00d7-37e5-4476-be9d-66ca34981dbb tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1738 microversion: 2.20 time: 0.242719 Aug 30 01:11:16.994473 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 457/922] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:16 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:17.127064 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-6bc2b009-72ed-4437-abf8-d50af0c6cf5d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:17.128237 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-67411382-f6f2-4624-a56a-e080936abab4 req-08514ac9-dad2-4897-8a94-c8186db2da9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d3e6518-0173-4f31-ba51-d3fe0f2980e0", "tag": "45ea4fde-69bf-4651-956f-e265b3f4ca34"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:17.128379 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-6bc2b009-72ed-4437-abf8-d50af0c6cf5d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:17.136514 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6bc2b009-72ed-4437-abf8-d50af0c6cf5d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:17.137522 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6bc2b009-72ed-4437-abf8-d50af0c6cf5d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:17.138189 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6bc2b009-72ed-4437-abf8-d50af0c6cf5d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:17.142765 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6bc2b009-72ed-4437-abf8-d50af0c6cf5d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:17.142941 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-67411382-f6f2-4624-a56a-e080936abab4 req-08514ac9-dad2-4897-8a94-c8186db2da9c service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:17.142941 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-67411382-f6f2-4624-a56a-e080936abab4 req-08514ac9-dad2-4897-8a94-c8186db2da9c service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:17.142941 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-67411382-f6f2-4624-a56a-e080936abab4 req-08514ac9-dad2-4897-8a94-c8186db2da9c service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:17.145409 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6bc2b009-72ed-4437-abf8-d50af0c6cf5d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:17.146328 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6bc2b009-72ed-4437-abf8-d50af0c6cf5d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:17.154817 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-67411382-f6f2-4624-a56a-e080936abab4 req-08514ac9-dad2-4897-8a94-c8186db2da9c service nova] Creating event network-changed:45ea4fde-69bf-4651-956f-e265b3f4ca34 for instance 9d3e6518-0173-4f31-ba51-d3fe0f2980e0 on hv-cinder-81514 Aug 30 01:11:17.160567 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-67411382-f6f2-4624-a56a-e080936abab4 req-08514ac9-dad2-4897-8a94-c8186db2da9c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035699 Aug 30 01:11:17.161463 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 458/923] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:11:17.187300 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-6bc2b009-72ed-4437-abf8-d50af0c6cf5d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Going to try to terminate instance {{(pid=120630) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:11:17.305997 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-6bc2b009-72ed-4437-abf8-d50af0c6cf5d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 204 len: 0 microversion: 2.1 time: 0.182675 Aug 30 01:11:17.309338 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 466/924] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:11:17 2022] DELETE /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:11:17.319506 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-a2230e15-1ed6-4828-8aec-dd16ad79c0f9 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:17.320227 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-a2230e15-1ed6-4828-8aec-dd16ad79c0f9 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:17.339498 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a2230e15-1ed6-4828-8aec-dd16ad79c0f9 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:17.340007 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a2230e15-1ed6-4828-8aec-dd16ad79c0f9 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:17.340439 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a2230e15-1ed6-4828-8aec-dd16ad79c0f9 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:17.341383 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a2230e15-1ed6-4828-8aec-dd16ad79c0f9 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:17.346172 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a2230e15-1ed6-4828-8aec-dd16ad79c0f9 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:17.346830 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a2230e15-1ed6-4828-8aec-dd16ad79c0f9 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:17.541144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-a2230e15-1ed6-4828-8aec-dd16ad79c0f9 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:17.551643 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-a2230e15-1ed6-4828-8aec-dd16ad79c0f9 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 200 len: 1579 microversion: 2.1 time: 0.238128 Aug 30 01:11:17.552578 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 459/925] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:17 2022] GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 1579 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:18.024080 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-7359fe45-2909-4228-be35-6fda9ff50fc0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:18.025170 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-7359fe45-2909-4228-be35-6fda9ff50fc0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:18.032097 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7359fe45-2909-4228-be35-6fda9ff50fc0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:18.032593 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7359fe45-2909-4228-be35-6fda9ff50fc0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:18.033037 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7359fe45-2909-4228-be35-6fda9ff50fc0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:18.033845 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7359fe45-2909-4228-be35-6fda9ff50fc0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:18.034445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7359fe45-2909-4228-be35-6fda9ff50fc0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:18.034889 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7359fe45-2909-4228-be35-6fda9ff50fc0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:18.230276 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7359fe45-2909-4228-be35-6fda9ff50fc0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:18.242683 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7359fe45-2909-4228-be35-6fda9ff50fc0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:18.244214 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7359fe45-2909-4228-be35-6fda9ff50fc0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:18.245488 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-7359fe45-2909-4228-be35-6fda9ff50fc0 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1738 microversion: 2.20 time: 0.225897 Aug 30 01:11:18.260794 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 467/926] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:18 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:18.575345 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-eb3bd937-caf3-470a-828f-d1226c31375d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:18.575345 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-eb3bd937-caf3-470a-828f-d1226c31375d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:18.583108 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-eb3bd937-caf3-470a-828f-d1226c31375d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:18.583680 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-eb3bd937-caf3-470a-828f-d1226c31375d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:18.584315 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-eb3bd937-caf3-470a-828f-d1226c31375d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:18.585056 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-eb3bd937-caf3-470a-828f-d1226c31375d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:18.585543 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-eb3bd937-caf3-470a-828f-d1226c31375d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:18.585973 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-eb3bd937-caf3-470a-828f-d1226c31375d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:18.740479 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-eb3bd937-caf3-470a-828f-d1226c31375d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:18.751017 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-eb3bd937-caf3-470a-828f-d1226c31375d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 200 len: 1579 microversion: 2.1 time: 0.180715 Aug 30 01:11:18.766186 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 460/927] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:18 2022] GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 1579 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:19.269801 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-625088de-cdc3-4a98-99e3-8513aac5959e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:19.272280 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-625088de-cdc3-4a98-99e3-8513aac5959e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:19.281032 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-625088de-cdc3-4a98-99e3-8513aac5959e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:19.282596 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-625088de-cdc3-4a98-99e3-8513aac5959e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:19.283234 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-625088de-cdc3-4a98-99e3-8513aac5959e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:19.284130 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-625088de-cdc3-4a98-99e3-8513aac5959e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:19.284752 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-625088de-cdc3-4a98-99e3-8513aac5959e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:19.285404 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-625088de-cdc3-4a98-99e3-8513aac5959e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:19.528293 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-625088de-cdc3-4a98-99e3-8513aac5959e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:19.542842 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-625088de-cdc3-4a98-99e3-8513aac5959e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:19.544335 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-625088de-cdc3-4a98-99e3-8513aac5959e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:19.545667 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-625088de-cdc3-4a98-99e3-8513aac5959e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1738 microversion: 2.20 time: 0.281477 Aug 30 01:11:19.546916 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 468/928] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:19 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1738 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:19.747229 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-664868d7-ea41-4b06-8430-ade62f80155c req-bcdd37b1-002d-4af3-9059-a172ec864b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3e6518-0173-4f31-ba51-d3fe0f2980e0", "name": "network-vif-deleted", "tag": "45ea4fde-69bf-4651-956f-e265b3f4ca34"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:19.775757 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-fd62da3d-a07c-4ac0-8a8f-f0738e49a773 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:19.777438 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-fd62da3d-a07c-4ac0-8a8f-f0738e49a773 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:19.785665 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fd62da3d-a07c-4ac0-8a8f-f0738e49a773 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:19.787002 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fd62da3d-a07c-4ac0-8a8f-f0738e49a773 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:19.787636 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fd62da3d-a07c-4ac0-8a8f-f0738e49a773 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:19.787772 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-664868d7-ea41-4b06-8430-ade62f80155c req-bcdd37b1-002d-4af3-9059-a172ec864b74 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:19.788462 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-664868d7-ea41-4b06-8430-ade62f80155c req-bcdd37b1-002d-4af3-9059-a172ec864b74 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:19.788819 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fd62da3d-a07c-4ac0-8a8f-f0738e49a773 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:19.789099 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-664868d7-ea41-4b06-8430-ade62f80155c req-bcdd37b1-002d-4af3-9059-a172ec864b74 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:19.789415 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fd62da3d-a07c-4ac0-8a8f-f0738e49a773 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:19.789856 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fd62da3d-a07c-4ac0-8a8f-f0738e49a773 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:19.801374 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-664868d7-ea41-4b06-8430-ade62f80155c req-bcdd37b1-002d-4af3-9059-a172ec864b74 service nova] Creating event network-vif-deleted:45ea4fde-69bf-4651-956f-e265b3f4ca34 for instance 9d3e6518-0173-4f31-ba51-d3fe0f2980e0 on hv-cinder-81514 Aug 30 01:11:19.807573 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-664868d7-ea41-4b06-8430-ade62f80155c req-bcdd37b1-002d-4af3-9059-a172ec864b74 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065028 Aug 30 01:11:19.809014 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 461/929] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:11:19.866668 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-fd62da3d-a07c-4ac0-8a8f-f0738e49a773 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:19.877678 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-fd62da3d-a07c-4ac0-8a8f-f0738e49a773 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 200 len: 1392 microversion: 2.1 time: 0.106905 Aug 30 01:11:19.878287 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 469/930] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:19 2022] GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 1392 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:20.570947 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-24b79a0c-6e1c-4855-a3cf-a468cb60108e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:20.571638 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-24b79a0c-6e1c-4855-a3cf-a468cb60108e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:20.579463 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-24b79a0c-6e1c-4855-a3cf-a468cb60108e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:20.580058 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-24b79a0c-6e1c-4855-a3cf-a468cb60108e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:20.580528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-24b79a0c-6e1c-4855-a3cf-a468cb60108e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:20.581554 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-24b79a0c-6e1c-4855-a3cf-a468cb60108e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:20.582009 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-24b79a0c-6e1c-4855-a3cf-a468cb60108e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:20.582433 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-24b79a0c-6e1c-4855-a3cf-a468cb60108e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:20.719984 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-24b79a0c-6e1c-4855-a3cf-a468cb60108e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:20.728078 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-24b79a0c-6e1c-4855-a3cf-a468cb60108e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:20.729646 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-24b79a0c-6e1c-4855-a3cf-a468cb60108e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:20.731236 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-24b79a0c-6e1c-4855-a3cf-a468cb60108e tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1738 microversion: 2.20 time: 0.164787 Aug 30 01:11:20.731796 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 462/931] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:20 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:20.900408 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-451d835e-11fd-4bdb-9541-c424e83d265a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:20.901751 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-451d835e-11fd-4bdb-9541-c424e83d265a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:20.917269 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-451d835e-11fd-4bdb-9541-c424e83d265a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:20.917737 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-451d835e-11fd-4bdb-9541-c424e83d265a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:20.918171 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-451d835e-11fd-4bdb-9541-c424e83d265a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:20.918873 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-451d835e-11fd-4bdb-9541-c424e83d265a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:20.919323 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-451d835e-11fd-4bdb-9541-c424e83d265a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:20.919743 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-451d835e-11fd-4bdb-9541-c424e83d265a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:20.940815 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:20.958030 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-451d835e-11fd-4bdb-9541-c424e83d265a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:20.958579 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-451d835e-11fd-4bdb-9541-c424e83d265a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:20.959023 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-451d835e-11fd-4bdb-9541-c424e83d265a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:20.959475 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.objects.instance [None req-451d835e-11fd-4bdb-9541-c424e83d265a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lazy-loading 'fault' on Instance uuid 9d3e6518-0173-4f31-ba51-d3fe0f2980e0 {{(pid=120630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:11:21.001287 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-451d835e-11fd-4bdb-9541-c424e83d265a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:21.008259 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-451d835e-11fd-4bdb-9541-c424e83d265a tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 200 len: 1185 microversion: 2.1 time: 0.111994 Aug 30 01:11:21.008819 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 470/932] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:20 2022] GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 1185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:21.755223 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-9c19155b-f4c7-4d53-b699-91f2614ad8e8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:21.755843 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-9c19155b-f4c7-4d53-b699-91f2614ad8e8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:21.764012 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9c19155b-f4c7-4d53-b699-91f2614ad8e8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:21.764500 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9c19155b-f4c7-4d53-b699-91f2614ad8e8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:21.764947 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9c19155b-f4c7-4d53-b699-91f2614ad8e8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:21.765688 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9c19155b-f4c7-4d53-b699-91f2614ad8e8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:21.766240 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9c19155b-f4c7-4d53-b699-91f2614ad8e8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:21.766671 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9c19155b-f4c7-4d53-b699-91f2614ad8e8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:22.030405 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-06f0dd8c-51e8-4998-a00f-cc258c872de5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:22.031047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-06f0dd8c-51e8-4998-a00f-cc258c872de5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: 9d3e6518-0173-4f31-ba51-d3fe0f2980e0] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:22.038632 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-06f0dd8c-51e8-4998-a00f-cc258c872de5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:22.039126 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-06f0dd8c-51e8-4998-a00f-cc258c872de5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:22.039562 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-06f0dd8c-51e8-4998-a00f-cc258c872de5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:22.040267 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-06f0dd8c-51e8-4998-a00f-cc258c872de5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:22.040718 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-06f0dd8c-51e8-4998-a00f-cc258c872de5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:22.041559 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-06f0dd8c-51e8-4998-a00f-cc258c872de5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:22.055407 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-06f0dd8c-51e8-4998-a00f-cc258c872de5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] HTTP exception thrown: Instance 9d3e6518-0173-4f31-ba51-d3fe0f2980e0 could not be found. Aug 30 01:11:22.057692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-06f0dd8c-51e8-4998-a00f-cc258c872de5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Request method failure captured: Aug 30 01:11:22.057692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 HTTP/1.1 Aug 30 01:11:22.057692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:11:22.057692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:11:22.057692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:11:22.057692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:11:22.057692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:11:22.057692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:11:22.057692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:11:22.057692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:11:22.057692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWH5IlMs3-PpHgd-64GQoKqCaYDnstpx6kV6o3lhXrt1goFY9zuK7pTG28ziFU88vli500Zzc1_BL4IQjNvN2Nv36HyTmpwmkKHq5cZcWjPqmBgXs-ukJr77nRZfd4jHL-ffnB5cvyWaSGoqPsCJALB7h_4RB4a5CmfAV8vI5rS-xyU Aug 30 01:11:22.057692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:11:22.057692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:11:22.057692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:11:22.057692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:11:22.057692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:11:22.057692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:11:22.057692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: a6380baa172744fa9d7ba5b81f847906 Aug 30 01:11:22.057692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-TestVolumeBootPattern-1693715583 Aug 30 01:11:22.057692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:11:22.057692 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:11:22.059368 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a6380baa172744fa9d7ba5b81f847906"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a6380baa172744fa9d7ba5b81f847906"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a6380baa172744fa9d7ba5b81f847906"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a6380baa172744fa9d7ba5b81f847906"}]}] Aug 30 01:11:22.059368 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-TestVolumeBootPattern-1693715583 Aug 30 01:11:22.059368 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: a6380baa172744fa9d7ba5b81f847906 Aug 30 01:11:22.059368 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-TestVolumeBootPattern-1693715583 Aug 30 01:11:22.059368 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-TestVolumeBootPattern-1693715583-project Aug 30 01:11:22.059368 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:11:22.059368 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:11:22.059368 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: d467895d586a43719d2abdf4105187f8 Aug 30 01:11:22.059368 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-TestVolumeBootPattern-1693715583-project Aug 30 01:11:22.059368 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:11:22.059368 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Instance 9d3e6518-0173-4f31-ba51-d3fe0f2980e0 could not be found. Aug 30 01:11:22.059368 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': '9d3e6518-0173-4f31-ba51-d3fe0f2980e0'} Aug 30 01:11:22.060218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:11:22.060218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:11:22.060218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:11:22.060218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:11:22.060218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:11:22.060218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:11:22.060218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:11:22.060218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:11:22.060218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:11:22.060218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:11:22.060218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d3e6518-0173-4f31-ba51-d3fe0f2980e0 could not be found. Aug 30 01:11:22.060218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:11:22.060218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:11:22.060218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:11:22.060218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:11:22.060218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:11:22.060218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:11:22.060218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:11:22.060218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:11:22.060218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:11:22.061797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:11:22.061797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:11:22.061797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:11:22.061797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:11:22.061797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:11:22.061797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:11:22.061797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:11:22.061797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d3e6518-0173-4f31-ba51-d3fe0f2980e0 could not be found. Aug 30 01:11:22.061797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:11:22.061797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:11:22.061797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:11:22.061797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:11:22.061797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:11:22.061797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:11:22.061797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:11:22.061797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:11:22.061797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d3e6518-0173-4f31-ba51-d3fe0f2980e0 could not be found. Aug 30 01:11:22.061797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:11:22.063126 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-06f0dd8c-51e8-4998-a00f-cc258c872de5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Returning 404 to user: Instance 9d3e6518-0173-4f31-ba51-d3fe0f2980e0 could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:11:22.063126 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-06f0dd8c-51e8-4998-a00f-cc258c872de5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0" status: 404 len: 111 microversion: 2.1 time: 0.032869 Aug 30 01:11:22.063126 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 471/933] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:22 2022] GET /compute/v2.1/servers/9d3e6518-0173-4f31-ba51-d3fe0f2980e0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:11:22.182590 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-9c19155b-f4c7-4d53-b699-91f2614ad8e8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:22.190714 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-9c19155b-f4c7-4d53-b699-91f2614ad8e8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:22.192171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-9c19155b-f4c7-4d53-b699-91f2614ad8e8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:22.193373 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-9c19155b-f4c7-4d53-b699-91f2614ad8e8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1720 microversion: 2.20 time: 0.442268 Aug 30 01:11:22.193944 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 463/934] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:21 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1720 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:23.217243 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-6945d62c-f9bf-4cc3-bc8c-cfb635586677 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:23.217875 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-6945d62c-f9bf-4cc3-bc8c-cfb635586677 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:23.224179 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6945d62c-f9bf-4cc3-bc8c-cfb635586677 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:23.224662 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6945d62c-f9bf-4cc3-bc8c-cfb635586677 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:23.225122 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6945d62c-f9bf-4cc3-bc8c-cfb635586677 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:23.225832 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6945d62c-f9bf-4cc3-bc8c-cfb635586677 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:23.226287 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6945d62c-f9bf-4cc3-bc8c-cfb635586677 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:23.226830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6945d62c-f9bf-4cc3-bc8c-cfb635586677 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:23.362899 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-6945d62c-f9bf-4cc3-bc8c-cfb635586677 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:23.371306 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-6945d62c-f9bf-4cc3-bc8c-cfb635586677 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:23.372762 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-6945d62c-f9bf-4cc3-bc8c-cfb635586677 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:23.373994 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-6945d62c-f9bf-4cc3-bc8c-cfb635586677 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1720 microversion: 2.20 time: 0.161265 Aug 30 01:11:23.374555 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 472/935] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:23 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:24.397721 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-73ec05b9-a03a-4020-86f1-f5c2f8212c98 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:24.399036 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-73ec05b9-a03a-4020-86f1-f5c2f8212c98 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:24.406369 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-73ec05b9-a03a-4020-86f1-f5c2f8212c98 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:24.406863 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-73ec05b9-a03a-4020-86f1-f5c2f8212c98 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:24.407551 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-73ec05b9-a03a-4020-86f1-f5c2f8212c98 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:24.408546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-73ec05b9-a03a-4020-86f1-f5c2f8212c98 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:24.409196 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-73ec05b9-a03a-4020-86f1-f5c2f8212c98 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:24.409806 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-73ec05b9-a03a-4020-86f1-f5c2f8212c98 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:24.780557 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-73ec05b9-a03a-4020-86f1-f5c2f8212c98 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:24.788872 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-73ec05b9-a03a-4020-86f1-f5c2f8212c98 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:24.790352 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-73ec05b9-a03a-4020-86f1-f5c2f8212c98 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:24.791548 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-73ec05b9-a03a-4020-86f1-f5c2f8212c98 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1663 microversion: 2.20 time: 0.398171 Aug 30 01:11:24.800423 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 464/936] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:24 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1663 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:24.815479 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-6207788e-832b-46d8-ba49-6dbf9d678195 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4aa5f7b6-b216-4b26-8ee3-561d2c122065"}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:24.817856 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-6207788e-832b-46d8-ba49-6dbf9d678195 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:24.824919 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6207788e-832b-46d8-ba49-6dbf9d678195 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:24.825494 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6207788e-832b-46d8-ba49-6dbf9d678195 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:24.826004 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6207788e-832b-46d8-ba49-6dbf9d678195 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:24.826710 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6207788e-832b-46d8-ba49-6dbf9d678195 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:24.827759 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6207788e-832b-46d8-ba49-6dbf9d678195 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:24.828437 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6207788e-832b-46d8-ba49-6dbf9d678195 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:25.123440 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-6207788e-832b-46d8-ba49-6dbf9d678195 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "POST /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.312010 Aug 30 01:11:25.124227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 473/937] 10.222.0.78 () {62 vars in 1364 bytes} [Tue Aug 30 01:11:24 2022] POST /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad/os-volume_attachments => generated 188 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:11:25.211007 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-224f1d5c-6c62-4888-afdc-1b5a680eb1d7 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:25.211504 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-224f1d5c-6c62-4888-afdc-1b5a680eb1d7 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: a99c1ea6-9c8f-42ac-a6b3-6c66a025711d] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:25.213106 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-11f58bda-190a-4886-94d6-a314cb7489c2 req-e24d521d-2dd5-4687-a8f1-8f0809b9a179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a99c1ea6-9c8f-42ac-a6b3-6c66a025711d", "tag": "c3521186-7bff-4b1d-bccf-696dc8dddb74"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:25.219178 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-224f1d5c-6c62-4888-afdc-1b5a680eb1d7 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:25.219671 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-224f1d5c-6c62-4888-afdc-1b5a680eb1d7 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:25.220105 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-224f1d5c-6c62-4888-afdc-1b5a680eb1d7 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:25.220809 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-224f1d5c-6c62-4888-afdc-1b5a680eb1d7 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:25.221291 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-224f1d5c-6c62-4888-afdc-1b5a680eb1d7 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:25.221719 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-224f1d5c-6c62-4888-afdc-1b5a680eb1d7 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:25.234556 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-11f58bda-190a-4886-94d6-a314cb7489c2 req-e24d521d-2dd5-4687-a8f1-8f0809b9a179 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:25.235336 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-11f58bda-190a-4886-94d6-a314cb7489c2 req-e24d521d-2dd5-4687-a8f1-8f0809b9a179 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:25.236010 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-11f58bda-190a-4886-94d6-a314cb7489c2 req-e24d521d-2dd5-4687-a8f1-8f0809b9a179 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:25.249190 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-224f1d5c-6c62-4888-afdc-1b5a680eb1d7 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: a99c1ea6-9c8f-42ac-a6b3-6c66a025711d] Going to try to terminate instance {{(pid=120631) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:11:25.252065 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-11f58bda-190a-4886-94d6-a314cb7489c2 req-e24d521d-2dd5-4687-a8f1-8f0809b9a179 service nova] Creating event network-changed:c3521186-7bff-4b1d-bccf-696dc8dddb74 for instance a99c1ea6-9c8f-42ac-a6b3-6c66a025711d on hv-cinder-81514 Aug 30 01:11:25.258179 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-11f58bda-190a-4886-94d6-a314cb7489c2 req-e24d521d-2dd5-4687-a8f1-8f0809b9a179 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048641 Aug 30 01:11:25.259619 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 474/938] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:11:25.266447 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=100 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:25.293694 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-3be8fa82-e4dd-4933-a3b7-4272be8ff673 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:25.294466 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-3be8fa82-e4dd-4933-a3b7-4272be8ff673 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:25.301918 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3be8fa82-e4dd-4933-a3b7-4272be8ff673 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:25.304798 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3be8fa82-e4dd-4933-a3b7-4272be8ff673 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:25.305567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3be8fa82-e4dd-4933-a3b7-4272be8ff673 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:25.306544 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3be8fa82-e4dd-4933-a3b7-4272be8ff673 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:25.307881 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3be8fa82-e4dd-4933-a3b7-4272be8ff673 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:25.308467 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3be8fa82-e4dd-4933-a3b7-4272be8ff673 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:25.369398 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-224f1d5c-6c62-4888-afdc-1b5a680eb1d7 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d" status: 204 len: 0 microversion: 2.1 time: 0.160274 Aug 30 01:11:25.370679 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 465/939] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:11:25 2022] DELETE /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:11:25.380620 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-4fe501c5-ea96-4fa8-8827-c0383052d3b9 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:25.381462 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-4fe501c5-ea96-4fa8-8827-c0383052d3b9 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: a99c1ea6-9c8f-42ac-a6b3-6c66a025711d] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:25.388977 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4fe501c5-ea96-4fa8-8827-c0383052d3b9 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:25.389957 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4fe501c5-ea96-4fa8-8827-c0383052d3b9 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:25.391039 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4fe501c5-ea96-4fa8-8827-c0383052d3b9 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:25.391837 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4fe501c5-ea96-4fa8-8827-c0383052d3b9 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:25.392917 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4fe501c5-ea96-4fa8-8827-c0383052d3b9 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:25.393390 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-4fe501c5-ea96-4fa8-8827-c0383052d3b9 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:25.572779 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-4fe501c5-ea96-4fa8-8827-c0383052d3b9 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:25.582070 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-4fe501c5-ea96-4fa8-8827-c0383052d3b9 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d" status: 200 len: 1579 microversion: 2.1 time: 0.206093 Aug 30 01:11:25.582636 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 466/940] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:25 2022] GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d => generated 1579 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:25.605528 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-3be8fa82-e4dd-4933-a3b7-4272be8ff673 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "DELETE /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad/os-volume_attachments/4aa5f7b6-b216-4b26-8ee3-561d2c122065" status: 202 len: 0 microversion: 2.20 time: 0.316869 Aug 30 01:11:25.606597 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 475/941] 10.222.0.78 () {60 vars in 1457 bytes} [Tue Aug 30 01:11:25 2022] DELETE /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad/os-volume_attachments/4aa5f7b6-b216-4b26-8ee3-561d2c122065 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:11:25.669693 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-9cc22ad2-80d6-457b-a24d-940853cc233b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:25.670303 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-9cc22ad2-80d6-457b-a24d-940853cc233b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:25.677928 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-4d0401be-6109-445c-a9bd-d07ae2a10390 req-7876ebed-eba0-4d85-8c00-2717961a4572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7e7483-c8ec-40f2-814d-aba9573395ad", "name": "network-vif-unplugged", "status": "completed", "tag": "729c26fe-a4b3-4cc3-b9e9-2603f916a1c4"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:25.687275 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9cc22ad2-80d6-457b-a24d-940853cc233b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:25.687780 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9cc22ad2-80d6-457b-a24d-940853cc233b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:25.688204 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-4d0401be-6109-445c-a9bd-d07ae2a10390 req-7876ebed-eba0-4d85-8c00-2717961a4572 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:25.688481 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9cc22ad2-80d6-457b-a24d-940853cc233b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:25.688657 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-4d0401be-6109-445c-a9bd-d07ae2a10390 req-7876ebed-eba0-4d85-8c00-2717961a4572 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:25.688910 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9cc22ad2-80d6-457b-a24d-940853cc233b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:25.689112 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-4d0401be-6109-445c-a9bd-d07ae2a10390 req-7876ebed-eba0-4d85-8c00-2717961a4572 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:25.689770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9cc22ad2-80d6-457b-a24d-940853cc233b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:25.690173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9cc22ad2-80d6-457b-a24d-940853cc233b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:25.701699 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.compute.server_external_events [req-4d0401be-6109-445c-a9bd-d07ae2a10390 req-7876ebed-eba0-4d85-8c00-2717961a4572 service nova] Unable to find a host for instance aa7e7483-c8ec-40f2-814d-aba9573395ad. Dropping event network-vif-unplugged {{(pid=120630) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 01:11:25.702677 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-4d0401be-6109-445c-a9bd-d07ae2a10390 req-7876ebed-eba0-4d85-8c00-2717961a4572 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028546 Aug 30 01:11:25.703652 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 476/942] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 01:11:25.724388 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-9cc22ad2-80d6-457b-a24d-940853cc233b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120631) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 01:11:25.795029 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-9cc22ad2-80d6-457b-a24d-940853cc233b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "POST /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad/action" status: 202 len: 0 microversion: 2.20 time: 0.130312 Aug 30 01:11:25.798703 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 467/943] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Aug 30 01:11:25 2022] POST /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:11:25.806290 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-7f9d2fc9-1a8a-4ce2-82e7-0b238459ad8f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:25.806669 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-7f9d2fc9-1a8a-4ce2-82e7-0b238459ad8f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:25.814290 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7f9d2fc9-1a8a-4ce2-82e7-0b238459ad8f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:25.814786 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7f9d2fc9-1a8a-4ce2-82e7-0b238459ad8f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:25.815568 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7f9d2fc9-1a8a-4ce2-82e7-0b238459ad8f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:25.816111 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7f9d2fc9-1a8a-4ce2-82e7-0b238459ad8f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:25.816369 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7f9d2fc9-1a8a-4ce2-82e7-0b238459ad8f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:25.816858 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7f9d2fc9-1a8a-4ce2-82e7-0b238459ad8f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:25.985801 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7f9d2fc9-1a8a-4ce2-82e7-0b238459ad8f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:25.994798 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7f9d2fc9-1a8a-4ce2-82e7-0b238459ad8f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:25.996297 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7f9d2fc9-1a8a-4ce2-82e7-0b238459ad8f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:25.997578 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-7f9d2fc9-1a8a-4ce2-82e7-0b238459ad8f tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1671 microversion: 2.20 time: 0.197588 Aug 30 01:11:25.998146 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 477/944] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:25 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1671 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:26.607458 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-c27b5d03-f628-4fe9-9ac3-23fbbd6cd53c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:26.608076 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-c27b5d03-f628-4fe9-9ac3-23fbbd6cd53c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: a99c1ea6-9c8f-42ac-a6b3-6c66a025711d] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:26.610051 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:26.616255 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c27b5d03-f628-4fe9-9ac3-23fbbd6cd53c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:26.616742 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c27b5d03-f628-4fe9-9ac3-23fbbd6cd53c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:26.617284 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c27b5d03-f628-4fe9-9ac3-23fbbd6cd53c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:26.617979 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c27b5d03-f628-4fe9-9ac3-23fbbd6cd53c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:26.618436 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c27b5d03-f628-4fe9-9ac3-23fbbd6cd53c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:26.618865 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c27b5d03-f628-4fe9-9ac3-23fbbd6cd53c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:26.785223 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-c27b5d03-f628-4fe9-9ac3-23fbbd6cd53c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:26.794062 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-c27b5d03-f628-4fe9-9ac3-23fbbd6cd53c tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d" status: 200 len: 1579 microversion: 2.1 time: 0.191845 Aug 30 01:11:26.794804 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 468/945] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:26 2022] GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d => generated 1579 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:27.022818 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-cf2e8c73-52ba-4f82-a83c-642f4bc50c0c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:27.023498 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-cf2e8c73-52ba-4f82-a83c-642f4bc50c0c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:27.031210 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cf2e8c73-52ba-4f82-a83c-642f4bc50c0c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:27.031850 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cf2e8c73-52ba-4f82-a83c-642f4bc50c0c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:27.032502 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cf2e8c73-52ba-4f82-a83c-642f4bc50c0c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:27.033424 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cf2e8c73-52ba-4f82-a83c-642f4bc50c0c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:27.033984 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cf2e8c73-52ba-4f82-a83c-642f4bc50c0c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:27.035161 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-cf2e8c73-52ba-4f82-a83c-642f4bc50c0c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:27.178808 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-cf2e8c73-52ba-4f82-a83c-642f4bc50c0c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:27.187608 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-cf2e8c73-52ba-4f82-a83c-642f4bc50c0c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:27.189067 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-cf2e8c73-52ba-4f82-a83c-642f4bc50c0c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:27.190259 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-cf2e8c73-52ba-4f82-a83c-642f4bc50c0c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1729 microversion: 2.20 time: 0.172829 Aug 30 01:11:27.190818 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 478/946] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:27 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:27.392863 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-5f2097e4-962c-4997-b663-b5b850633043 req-078def18-fab8-441a-9602-20fa1c33f9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99c1ea6-9c8f-42ac-a6b3-6c66a025711d", "name": "network-vif-deleted", "tag": "c3521186-7bff-4b1d-bccf-696dc8dddb74"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:27.403689 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-5f2097e4-962c-4997-b663-b5b850633043 req-078def18-fab8-441a-9602-20fa1c33f9c9 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:27.404176 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-5f2097e4-962c-4997-b663-b5b850633043 req-078def18-fab8-441a-9602-20fa1c33f9c9 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:27.404604 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-5f2097e4-962c-4997-b663-b5b850633043 req-078def18-fab8-441a-9602-20fa1c33f9c9 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:27.417168 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-5f2097e4-962c-4997-b663-b5b850633043 req-078def18-fab8-441a-9602-20fa1c33f9c9 service nova] Creating event network-vif-deleted:c3521186-7bff-4b1d-bccf-696dc8dddb74 for instance a99c1ea6-9c8f-42ac-a6b3-6c66a025711d on hv-cinder-81514 Aug 30 01:11:27.422431 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-5f2097e4-962c-4997-b663-b5b850633043 req-078def18-fab8-441a-9602-20fa1c33f9c9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034074 Aug 30 01:11:27.423245 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 469/947] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:11:27.816654 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-dedfcfc1-4977-43c6-b9df-e3fc843304e4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:27.817592 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-dedfcfc1-4977-43c6-b9df-e3fc843304e4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: a99c1ea6-9c8f-42ac-a6b3-6c66a025711d] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:27.827108 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dedfcfc1-4977-43c6-b9df-e3fc843304e4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:27.828072 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dedfcfc1-4977-43c6-b9df-e3fc843304e4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:27.829039 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dedfcfc1-4977-43c6-b9df-e3fc843304e4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:27.829981 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dedfcfc1-4977-43c6-b9df-e3fc843304e4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:27.831192 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dedfcfc1-4977-43c6-b9df-e3fc843304e4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:27.832007 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dedfcfc1-4977-43c6-b9df-e3fc843304e4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:27.865771 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dedfcfc1-4977-43c6-b9df-e3fc843304e4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:27.866254 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dedfcfc1-4977-43c6-b9df-e3fc843304e4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:27.866690 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dedfcfc1-4977-43c6-b9df-e3fc843304e4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:27.867130 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.objects.instance [None req-dedfcfc1-4977-43c6-b9df-e3fc843304e4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lazy-loading 'fault' on Instance uuid a99c1ea6-9c8f-42ac-a6b3-6c66a025711d {{(pid=120630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:11:27.910269 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-dedfcfc1-4977-43c6-b9df-e3fc843304e4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd467895d586a43719d2abdf4105187f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6380baa172744fa9d7ba5b81f847906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:27.918072 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-dedfcfc1-4977-43c6-b9df-e3fc843304e4 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d" status: 200 len: 1231 microversion: 2.1 time: 0.106412 Aug 30 01:11:27.918628 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 479/948] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:27 2022] GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d => generated 1231 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:28.220795 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-dbe91965-9886-4fad-8312-6f89c6059bc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:28.221565 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-dbe91965-9886-4fad-8312-6f89c6059bc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:28.229608 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dbe91965-9886-4fad-8312-6f89c6059bc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:28.230299 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dbe91965-9886-4fad-8312-6f89c6059bc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:28.230742 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dbe91965-9886-4fad-8312-6f89c6059bc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:28.231446 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dbe91965-9886-4fad-8312-6f89c6059bc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:28.231902 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dbe91965-9886-4fad-8312-6f89c6059bc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:28.232332 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dbe91965-9886-4fad-8312-6f89c6059bc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:28.378544 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-dbe91965-9886-4fad-8312-6f89c6059bc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:28.387945 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-dbe91965-9886-4fad-8312-6f89c6059bc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:28.389567 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-dbe91965-9886-4fad-8312-6f89c6059bc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:28.390859 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-dbe91965-9886-4fad-8312-6f89c6059bc9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1729 microversion: 2.20 time: 0.175849 Aug 30 01:11:28.391529 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 470/949] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:28 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:28.939849 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f00a40ff-b49d-4a69-9705-c499f90c0407 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:28.940458 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-f00a40ff-b49d-4a69-9705-c499f90c0407 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: a99c1ea6-9c8f-42ac-a6b3-6c66a025711d] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:28.943133 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:28.949214 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f00a40ff-b49d-4a69-9705-c499f90c0407 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:28.949705 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f00a40ff-b49d-4a69-9705-c499f90c0407 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:28.950139 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f00a40ff-b49d-4a69-9705-c499f90c0407 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:28.950843 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f00a40ff-b49d-4a69-9705-c499f90c0407 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:28.951294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f00a40ff-b49d-4a69-9705-c499f90c0407 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:28.951718 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f00a40ff-b49d-4a69-9705-c499f90c0407 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:28.970056 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-f00a40ff-b49d-4a69-9705-c499f90c0407 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] HTTP exception thrown: Instance a99c1ea6-9c8f-42ac-a6b3-6c66a025711d could not be found. Aug 30 01:11:28.971728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f00a40ff-b49d-4a69-9705-c499f90c0407 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Request method failure captured: Aug 30 01:11:28.971728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d HTTP/1.1 Aug 30 01:11:28.971728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:11:28.971728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:11:28.971728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:11:28.971728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:11:28.971728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:11:28.971728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:11:28.971728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:11:28.971728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:11:28.971728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWH5IlMs3-PpHgd-64GQoKqCaYDnstpx6kV6o3lhXrt1goFY9zuK7pTG28ziFU88vli500Zzc1_BL4IQjNvN2Nv36HyTmpwmkKHq5cZcWjPqmBgXs-ukJr77nRZfd4jHL-ffnB5cvyWaSGoqPsCJALB7h_4RB4a5CmfAV8vI5rS-xyU Aug 30 01:11:28.971728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:11:28.971728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:11:28.971728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:11:28.971728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:11:28.971728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:11:28.971728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:11:28.971728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: a6380baa172744fa9d7ba5b81f847906 Aug 30 01:11:28.971728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-TestVolumeBootPattern-1693715583 Aug 30 01:11:28.971728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:11:28.971728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:11:28.973353 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a6380baa172744fa9d7ba5b81f847906"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a6380baa172744fa9d7ba5b81f847906"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a6380baa172744fa9d7ba5b81f847906"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a6380baa172744fa9d7ba5b81f847906"}]}] Aug 30 01:11:28.973353 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-TestVolumeBootPattern-1693715583 Aug 30 01:11:28.973353 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: a6380baa172744fa9d7ba5b81f847906 Aug 30 01:11:28.973353 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-TestVolumeBootPattern-1693715583 Aug 30 01:11:28.973353 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-TestVolumeBootPattern-1693715583-project Aug 30 01:11:28.973353 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:11:28.973353 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:11:28.973353 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: d467895d586a43719d2abdf4105187f8 Aug 30 01:11:28.973353 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-TestVolumeBootPattern-1693715583-project Aug 30 01:11:28.973353 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:11:28.973353 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Instance a99c1ea6-9c8f-42ac-a6b3-6c66a025711d could not be found. Aug 30 01:11:28.973353 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': 'a99c1ea6-9c8f-42ac-a6b3-6c66a025711d'} Aug 30 01:11:28.974224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:11:28.974224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:11:28.974224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:11:28.974224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:11:28.974224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:11:28.974224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:11:28.974224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:11:28.974224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:11:28.974224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:11:28.974224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:11:28.974224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99c1ea6-9c8f-42ac-a6b3-6c66a025711d could not be found. Aug 30 01:11:28.974224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:11:28.974224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:11:28.974224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:11:28.974224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:11:28.974224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:11:28.974224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:11:28.974224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:11:28.974224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:11:28.974224 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:11:28.975633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:11:28.975633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:11:28.975633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:11:28.975633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:11:28.975633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:11:28.975633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:11:28.975633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:11:28.975633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99c1ea6-9c8f-42ac-a6b3-6c66a025711d could not be found. Aug 30 01:11:28.975633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:11:28.975633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:11:28.975633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:11:28.975633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:11:28.975633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:11:28.975633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:11:28.975633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:11:28.975633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:11:28.975633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99c1ea6-9c8f-42ac-a6b3-6c66a025711d could not be found. Aug 30 01:11:28.975633 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:11:28.977120 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f00a40ff-b49d-4a69-9705-c499f90c0407 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Returning 404 to user: Instance a99c1ea6-9c8f-42ac-a6b3-6c66a025711d could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:11:28.977120 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-f00a40ff-b49d-4a69-9705-c499f90c0407 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d" status: 404 len: 111 microversion: 2.1 time: 0.037702 Aug 30 01:11:28.977120 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 480/950] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:28 2022] GET /compute/v2.1/servers/a99c1ea6-9c8f-42ac-a6b3-6c66a025711d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:11:29.414895 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-5844c9da-2d00-4eff-82d8-b7c9906a147b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:29.415516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-5844c9da-2d00-4eff-82d8-b7c9906a147b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:29.423254 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5844c9da-2d00-4eff-82d8-b7c9906a147b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:29.423746 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5844c9da-2d00-4eff-82d8-b7c9906a147b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:29.433046 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5844c9da-2d00-4eff-82d8-b7c9906a147b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:29.434508 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5844c9da-2d00-4eff-82d8-b7c9906a147b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:29.434646 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5844c9da-2d00-4eff-82d8-b7c9906a147b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:29.435120 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5844c9da-2d00-4eff-82d8-b7c9906a147b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:29.476890 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-1ce08390-f93f-451b-8c07-3380889ff57d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:29.477424 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-1ce08390-f93f-451b-8c07-3380889ff57d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:29.485096 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1ce08390-f93f-451b-8c07-3380889ff57d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:29.485605 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1ce08390-f93f-451b-8c07-3380889ff57d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:29.486043 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1ce08390-f93f-451b-8c07-3380889ff57d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:29.486757 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1ce08390-f93f-451b-8c07-3380889ff57d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:29.487213 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1ce08390-f93f-451b-8c07-3380889ff57d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:29.487638 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1ce08390-f93f-451b-8c07-3380889ff57d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:29.517122 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-1ce08390-f93f-451b-8c07-3380889ff57d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] HTTP exception thrown: Instance b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 could not be found. Aug 30 01:11:29.518967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-1ce08390-f93f-451b-8c07-3380889ff57d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Request method failure captured: Aug 30 01:11:29.518967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: DELETE /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 HTTP/1.1 Aug 30 01:11:29.518967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:11:29.518967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:11:29.518967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:11:29.518967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:11:29.518967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:11:29.518967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:11:29.518967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:11:29.518967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:11:29.518967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWH5IlMs3-PpHgd-64GQoKqCaYDnstpx6kV6o3lhXrt1goFY9zuK7pTG28ziFU88vli500Zzc1_BL4IQjNvN2Nv36HyTmpwmkKHq5cZcWjPqmBgXs-ukJr77nRZfd4jHL-ffnB5cvyWaSGoqPsCJALB7h_4RB4a5CmfAV8vI5rS-xyU Aug 30 01:11:29.518967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:11:29.518967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:11:29.518967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:11:29.518967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:11:29.518967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:11:29.518967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:11:29.518967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: a6380baa172744fa9d7ba5b81f847906 Aug 30 01:11:29.518967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-TestVolumeBootPattern-1693715583 Aug 30 01:11:29.518967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:11:29.518967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:11:29.520397 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a6380baa172744fa9d7ba5b81f847906"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a6380baa172744fa9d7ba5b81f847906"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a6380baa172744fa9d7ba5b81f847906"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a6380baa172744fa9d7ba5b81f847906"}]}] Aug 30 01:11:29.520397 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-TestVolumeBootPattern-1693715583 Aug 30 01:11:29.520397 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: a6380baa172744fa9d7ba5b81f847906 Aug 30 01:11:29.520397 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-TestVolumeBootPattern-1693715583 Aug 30 01:11:29.520397 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-TestVolumeBootPattern-1693715583-project Aug 30 01:11:29.520397 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:11:29.520397 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:11:29.520397 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: d467895d586a43719d2abdf4105187f8 Aug 30 01:11:29.520397 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-TestVolumeBootPattern-1693715583-project Aug 30 01:11:29.520397 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:11:29.520397 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Instance b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 could not be found. Aug 30 01:11:29.520397 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': 'b85f48c2-35d7-4cab-a969-7e1b1fb4bec7'} Aug 30 01:11:29.521188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:11:29.521188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:11:29.521188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:11:29.521188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:11:29.521188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:11:29.521188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:11:29.521188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:11:29.521188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:11:29.521188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:11:29.521188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:11:29.521188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 could not be found. Aug 30 01:11:29.521188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:11:29.521188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:11:29.521188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:11:29.521188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:11:29.521188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:11:29.521188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:11:29.521188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:11:29.521188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:11:29.521188 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:11:29.522766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:11:29.522766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:11:29.522766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:11:29.522766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:11:29.522766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:11:29.522766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:11:29.522766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:11:29.522766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:11:29.522766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:11:29.522766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 could not be found. Aug 30 01:11:29.522766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:11:29.522766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:11:29.522766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:11:29.522766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:11:29.522766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:11:29.522766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:11:29.522766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:11:29.522766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:11:29.522766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 could not be found. Aug 30 01:11:29.522766 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:11:29.524059 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-1ce08390-f93f-451b-8c07-3380889ff57d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Returning 404 to user: Instance b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:11:29.524059 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-1ce08390-f93f-451b-8c07-3380889ff57d tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 404 len: 111 microversion: 2.1 time: 0.047880 Aug 30 01:11:29.524059 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 481/951] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:11:29 2022] DELETE /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:11:29.534371 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-77faf9d2-b2af-42c2-95a8-493200ac96c1 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:29.535153 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-77faf9d2-b2af-42c2-95a8-493200ac96c1 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] [instance: b85f48c2-35d7-4cab-a969-7e1b1fb4bec7] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:29.544357 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-77faf9d2-b2af-42c2-95a8-493200ac96c1 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:29.545017 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-77faf9d2-b2af-42c2-95a8-493200ac96c1 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:29.545821 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-77faf9d2-b2af-42c2-95a8-493200ac96c1 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:29.546648 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-77faf9d2-b2af-42c2-95a8-493200ac96c1 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:29.547373 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-77faf9d2-b2af-42c2-95a8-493200ac96c1 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:29.547905 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-77faf9d2-b2af-42c2-95a8-493200ac96c1 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:29.566995 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-77faf9d2-b2af-42c2-95a8-493200ac96c1 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] HTTP exception thrown: Instance b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 could not be found. Aug 30 01:11:29.571316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-77faf9d2-b2af-42c2-95a8-493200ac96c1 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Request method failure captured: Aug 30 01:11:29.571316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 HTTP/1.1 Aug 30 01:11:29.571316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:11:29.571316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:11:29.571316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:11:29.571316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:11:29.571316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:11:29.571316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:11:29.571316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:11:29.571316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:11:29.571316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWH5IlMs3-PpHgd-64GQoKqCaYDnstpx6kV6o3lhXrt1goFY9zuK7pTG28ziFU88vli500Zzc1_BL4IQjNvN2Nv36HyTmpwmkKHq5cZcWjPqmBgXs-ukJr77nRZfd4jHL-ffnB5cvyWaSGoqPsCJALB7h_4RB4a5CmfAV8vI5rS-xyU Aug 30 01:11:29.571316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:11:29.571316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:11:29.571316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:11:29.571316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:11:29.571316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:11:29.571316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:11:29.571316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: a6380baa172744fa9d7ba5b81f847906 Aug 30 01:11:29.571316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-TestVolumeBootPattern-1693715583 Aug 30 01:11:29.571316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:11:29.571316 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:11:29.573720 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a6380baa172744fa9d7ba5b81f847906"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a6380baa172744fa9d7ba5b81f847906"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a6380baa172744fa9d7ba5b81f847906"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a6380baa172744fa9d7ba5b81f847906"}]}] Aug 30 01:11:29.573720 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-TestVolumeBootPattern-1693715583 Aug 30 01:11:29.573720 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: a6380baa172744fa9d7ba5b81f847906 Aug 30 01:11:29.573720 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-TestVolumeBootPattern-1693715583 Aug 30 01:11:29.573720 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-TestVolumeBootPattern-1693715583-project Aug 30 01:11:29.573720 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:11:29.573720 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:11:29.573720 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: d467895d586a43719d2abdf4105187f8 Aug 30 01:11:29.573720 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-TestVolumeBootPattern-1693715583-project Aug 30 01:11:29.573720 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:11:29.573720 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Instance b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 could not be found. Aug 30 01:11:29.573720 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': 'b85f48c2-35d7-4cab-a969-7e1b1fb4bec7'} Aug 30 01:11:29.574469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:11:29.574469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:11:29.574469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:11:29.574469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:11:29.574469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:11:29.574469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:11:29.574469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:11:29.574469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:11:29.574469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:11:29.574469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:11:29.574469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 could not be found. Aug 30 01:11:29.574469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:11:29.574469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:11:29.574469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:11:29.574469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:11:29.574469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:11:29.574469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:11:29.574469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:11:29.574469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:11:29.574469 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:11:29.575688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:11:29.575688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:11:29.575688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:11:29.575688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:11:29.575688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:11:29.575688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:11:29.575688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:11:29.575688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 could not be found. Aug 30 01:11:29.575688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:11:29.575688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:11:29.575688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:11:29.575688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:11:29.575688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:11:29.575688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:11:29.575688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:11:29.575688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:11:29.575688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 could not be found. Aug 30 01:11:29.575688 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:11:29.576849 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-77faf9d2-b2af-42c2-95a8-493200ac96c1 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Returning 404 to user: Instance b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:11:29.576849 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-77faf9d2-b2af-42c2-95a8-493200ac96c1 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7" status: 404 len: 111 microversion: 2.1 time: 0.043623 Aug 30 01:11:29.576849 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 482/952] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:29 2022] GET /compute/v2.1/servers/b85f48c2-35d7-4cab-a969-7e1b1fb4bec7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:11:29.652301 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-5844c9da-2d00-4eff-82d8-b7c9906a147b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:29.666760 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-5844c9da-2d00-4eff-82d8-b7c9906a147b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:29.670434 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-5844c9da-2d00-4eff-82d8-b7c9906a147b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:29.670434 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-5844c9da-2d00-4eff-82d8-b7c9906a147b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1729 microversion: 2.20 time: 0.258653 Aug 30 01:11:29.670830 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 471/953] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:29 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1729 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:30.695048 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-7fc12c2c-9abf-41ba-9071-9835e9ca2eee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:30.696417 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-7fc12c2c-9abf-41ba-9071-9835e9ca2eee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:30.704199 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7fc12c2c-9abf-41ba-9071-9835e9ca2eee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:30.704936 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7fc12c2c-9abf-41ba-9071-9835e9ca2eee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:30.705591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7fc12c2c-9abf-41ba-9071-9835e9ca2eee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:30.706686 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7fc12c2c-9abf-41ba-9071-9835e9ca2eee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:30.707382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7fc12c2c-9abf-41ba-9071-9835e9ca2eee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:30.707934 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7fc12c2c-9abf-41ba-9071-9835e9ca2eee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:30.875100 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7fc12c2c-9abf-41ba-9071-9835e9ca2eee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:30.886058 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7fc12c2c-9abf-41ba-9071-9835e9ca2eee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:30.888331 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7fc12c2c-9abf-41ba-9071-9835e9ca2eee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:30.889575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-7fc12c2c-9abf-41ba-9071-9835e9ca2eee tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1729 microversion: 2.20 time: 0.199127 Aug 30 01:11:30.901138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 483/954] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:30 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:30.981675 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-35bb396d-6907-4323-a330-d63217cfe9a5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] Calling method '.version_select at 0x7f0f5261aee0>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:31.004357 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-35bb396d-6907-4323-a330-d63217cfe9a5 tempest-TestVolumeBootPattern-1693715583 tempest-TestVolumeBootPattern-1693715583-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1418735735" status: 202 len: 0 microversion: 2.1 time: 0.026313 Aug 30 01:11:31.005637 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 472/955] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Aug 30 01:11:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1418735735 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:11:31.914323 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-fcde3e1b-3d3f-4b97-ba9c-7aab0d71658b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:31.916394 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-fcde3e1b-3d3f-4b97-ba9c-7aab0d71658b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:31.927392 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fcde3e1b-3d3f-4b97-ba9c-7aab0d71658b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:31.928148 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fcde3e1b-3d3f-4b97-ba9c-7aab0d71658b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:31.928606 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fcde3e1b-3d3f-4b97-ba9c-7aab0d71658b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:31.929450 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fcde3e1b-3d3f-4b97-ba9c-7aab0d71658b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:31.930281 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fcde3e1b-3d3f-4b97-ba9c-7aab0d71658b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:31.930988 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fcde3e1b-3d3f-4b97-ba9c-7aab0d71658b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:32.112530 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-fcde3e1b-3d3f-4b97-ba9c-7aab0d71658b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:32.135125 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-fcde3e1b-3d3f-4b97-ba9c-7aab0d71658b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:32.137636 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-fcde3e1b-3d3f-4b97-ba9c-7aab0d71658b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:32.139196 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-fcde3e1b-3d3f-4b97-ba9c-7aab0d71658b tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1729 microversion: 2.20 time: 0.229600 Aug 30 01:11:32.140366 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 484/956] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:31 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1729 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:33.166280 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-548a4f4a-fcaa-44ac-8edd-65f4d7e6db5d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:33.167002 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-548a4f4a-fcaa-44ac-8edd-65f4d7e6db5d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:33.175528 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-548a4f4a-fcaa-44ac-8edd-65f4d7e6db5d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:33.176022 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-548a4f4a-fcaa-44ac-8edd-65f4d7e6db5d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:33.176455 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-548a4f4a-fcaa-44ac-8edd-65f4d7e6db5d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:33.177203 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-548a4f4a-fcaa-44ac-8edd-65f4d7e6db5d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:33.178326 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-548a4f4a-fcaa-44ac-8edd-65f4d7e6db5d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:33.179072 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-548a4f4a-fcaa-44ac-8edd-65f4d7e6db5d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:33.469984 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-548a4f4a-fcaa-44ac-8edd-65f4d7e6db5d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:33.479013 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-548a4f4a-fcaa-44ac-8edd-65f4d7e6db5d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:33.482673 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-548a4f4a-fcaa-44ac-8edd-65f4d7e6db5d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:33.486882 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-548a4f4a-fcaa-44ac-8edd-65f4d7e6db5d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1729 microversion: 2.20 time: 0.324982 Aug 30 01:11:33.499889 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 473/957] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:33 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1729 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:34.514084 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-bd32c96e-5242-4134-95eb-c45f5a56e684 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:34.515545 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-bd32c96e-5242-4134-95eb-c45f5a56e684 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:34.529756 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bd32c96e-5242-4134-95eb-c45f5a56e684 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:34.533811 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bd32c96e-5242-4134-95eb-c45f5a56e684 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:34.534270 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bd32c96e-5242-4134-95eb-c45f5a56e684 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:34.535013 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bd32c96e-5242-4134-95eb-c45f5a56e684 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:34.535474 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bd32c96e-5242-4134-95eb-c45f5a56e684 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:34.535935 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bd32c96e-5242-4134-95eb-c45f5a56e684 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:34.574543 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:34.857587 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-bd32c96e-5242-4134-95eb-c45f5a56e684 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:34.872678 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-bd32c96e-5242-4134-95eb-c45f5a56e684 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:34.874614 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-bd32c96e-5242-4134-95eb-c45f5a56e684 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:34.876336 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-bd32c96e-5242-4134-95eb-c45f5a56e684 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1729 microversion: 2.20 time: 0.369555 Aug 30 01:11:34.890086 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 485/958] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:34 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1729 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:35.903127 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-370960c9-09dd-4050-8e24-06fce08e78b5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:35.903903 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-370960c9-09dd-4050-8e24-06fce08e78b5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:35.910092 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-370960c9-09dd-4050-8e24-06fce08e78b5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:35.910694 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-370960c9-09dd-4050-8e24-06fce08e78b5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:35.911229 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-370960c9-09dd-4050-8e24-06fce08e78b5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:35.912029 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-370960c9-09dd-4050-8e24-06fce08e78b5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:35.912574 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-370960c9-09dd-4050-8e24-06fce08e78b5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:35.913140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-370960c9-09dd-4050-8e24-06fce08e78b5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:36.068001 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-370960c9-09dd-4050-8e24-06fce08e78b5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:36.076455 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-370960c9-09dd-4050-8e24-06fce08e78b5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:36.077921 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-370960c9-09dd-4050-8e24-06fce08e78b5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:36.079439 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-370960c9-09dd-4050-8e24-06fce08e78b5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1729 microversion: 2.20 time: 0.181691 Aug 30 01:11:36.080059 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 474/959] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:35 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:37.104098 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-fc6b1610-b3af-46f3-a8ff-277be8b09b35 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:37.105178 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-fc6b1610-b3af-46f3-a8ff-277be8b09b35 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:37.111928 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fc6b1610-b3af-46f3-a8ff-277be8b09b35 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:37.112429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fc6b1610-b3af-46f3-a8ff-277be8b09b35 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:37.112908 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fc6b1610-b3af-46f3-a8ff-277be8b09b35 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:37.113642 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fc6b1610-b3af-46f3-a8ff-277be8b09b35 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:37.114295 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fc6b1610-b3af-46f3-a8ff-277be8b09b35 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:37.114728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-fc6b1610-b3af-46f3-a8ff-277be8b09b35 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:37.268603 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-fc6b1610-b3af-46f3-a8ff-277be8b09b35 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:37.278588 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-fc6b1610-b3af-46f3-a8ff-277be8b09b35 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:37.280033 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-fc6b1610-b3af-46f3-a8ff-277be8b09b35 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:37.281387 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-fc6b1610-b3af-46f3-a8ff-277be8b09b35 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1729 microversion: 2.20 time: 0.182288 Aug 30 01:11:37.282128 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 486/960] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:37 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:11:38.304810 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-c9669619-80fb-4e9d-ba14-182485cfd6d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:38.305389 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-c9669619-80fb-4e9d-ba14-182485cfd6d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:38.313943 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c9669619-80fb-4e9d-ba14-182485cfd6d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:38.314451 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c9669619-80fb-4e9d-ba14-182485cfd6d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:38.315438 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c9669619-80fb-4e9d-ba14-182485cfd6d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:38.316176 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c9669619-80fb-4e9d-ba14-182485cfd6d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:38.316636 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c9669619-80fb-4e9d-ba14-182485cfd6d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:38.317636 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c9669619-80fb-4e9d-ba14-182485cfd6d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:38.512910 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-c9669619-80fb-4e9d-ba14-182485cfd6d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:38.521489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-c9669619-80fb-4e9d-ba14-182485cfd6d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:38.523120 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-c9669619-80fb-4e9d-ba14-182485cfd6d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:38.524197 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-c9669619-80fb-4e9d-ba14-182485cfd6d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1729 microversion: 2.20 time: 0.223725 Aug 30 01:11:38.524727 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 475/961] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:38 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:39.546878 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-dd511b48-fb9e-4bc7-8731-b6e6a739b942 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:39.548166 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-dd511b48-fb9e-4bc7-8731-b6e6a739b942 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:39.555254 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dd511b48-fb9e-4bc7-8731-b6e6a739b942 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:39.556437 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dd511b48-fb9e-4bc7-8731-b6e6a739b942 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:39.557323 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dd511b48-fb9e-4bc7-8731-b6e6a739b942 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:39.558142 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dd511b48-fb9e-4bc7-8731-b6e6a739b942 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:39.559030 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dd511b48-fb9e-4bc7-8731-b6e6a739b942 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:39.560893 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-dd511b48-fb9e-4bc7-8731-b6e6a739b942 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:39.719870 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-dd511b48-fb9e-4bc7-8731-b6e6a739b942 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:39.728673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-dd511b48-fb9e-4bc7-8731-b6e6a739b942 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:39.730273 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-dd511b48-fb9e-4bc7-8731-b6e6a739b942 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:39.731760 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-dd511b48-fb9e-4bc7-8731-b6e6a739b942 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1729 microversion: 2.20 time: 0.188708 Aug 30 01:11:39.732338 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 487/962] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:39 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:40.755824 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-beed6ae6-9b14-4d52-abcc-c9fae57017ab tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:40.756432 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-beed6ae6-9b14-4d52-abcc-c9fae57017ab tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:40.763610 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-beed6ae6-9b14-4d52-abcc-c9fae57017ab tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:40.764092 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-beed6ae6-9b14-4d52-abcc-c9fae57017ab tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:40.764525 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-beed6ae6-9b14-4d52-abcc-c9fae57017ab tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:40.765253 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-beed6ae6-9b14-4d52-abcc-c9fae57017ab tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:40.765708 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-beed6ae6-9b14-4d52-abcc-c9fae57017ab tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:40.766131 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-beed6ae6-9b14-4d52-abcc-c9fae57017ab tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:40.953427 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-beed6ae6-9b14-4d52-abcc-c9fae57017ab tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:40.978854 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-beed6ae6-9b14-4d52-abcc-c9fae57017ab tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:40.983477 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-beed6ae6-9b14-4d52-abcc-c9fae57017ab tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:40.984797 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-beed6ae6-9b14-4d52-abcc-c9fae57017ab tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1729 microversion: 2.20 time: 0.232872 Aug 30 01:11:40.985480 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 476/963] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:40 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1729 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:41.584963 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-5500ec0e-3877-477f-bb74-2519d6068967 req-ef2bde7e-a05b-4b92-b96a-b2e736c7ed72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7e7483-c8ec-40f2-814d-aba9573395ad", "name": "network-vif-plugged", "status": "completed", "tag": "729c26fe-a4b3-4cc3-b9e9-2603f916a1c4"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:41.594793 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-5500ec0e-3877-477f-bb74-2519d6068967 req-ef2bde7e-a05b-4b92-b96a-b2e736c7ed72 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:41.595274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-5500ec0e-3877-477f-bb74-2519d6068967 req-ef2bde7e-a05b-4b92-b96a-b2e736c7ed72 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:41.595785 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-5500ec0e-3877-477f-bb74-2519d6068967 req-ef2bde7e-a05b-4b92-b96a-b2e736c7ed72 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:41.607310 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-5500ec0e-3877-477f-bb74-2519d6068967 req-ef2bde7e-a05b-4b92-b96a-b2e736c7ed72 service nova] Creating event network-vif-plugged:729c26fe-a4b3-4cc3-b9e9-2603f916a1c4 for instance aa7e7483-c8ec-40f2-814d-aba9573395ad on hv-cinder-81514 Aug 30 01:11:41.612367 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-5500ec0e-3877-477f-bb74-2519d6068967 req-ef2bde7e-a05b-4b92-b96a-b2e736c7ed72 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030986 Aug 30 01:11:41.613000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 488/964] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:11:42.007722 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-6f922a1c-8562-4a89-b5f5-a1b2891ca3fc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:42.008327 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-6f922a1c-8562-4a89-b5f5-a1b2891ca3fc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:42.015503 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6f922a1c-8562-4a89-b5f5-a1b2891ca3fc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:42.015980 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6f922a1c-8562-4a89-b5f5-a1b2891ca3fc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:42.016430 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6f922a1c-8562-4a89-b5f5-a1b2891ca3fc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:42.017146 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6f922a1c-8562-4a89-b5f5-a1b2891ca3fc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:42.017594 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6f922a1c-8562-4a89-b5f5-a1b2891ca3fc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:42.018009 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-6f922a1c-8562-4a89-b5f5-a1b2891ca3fc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:42.147890 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6f922a1c-8562-4a89-b5f5-a1b2891ca3fc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:42.156185 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6f922a1c-8562-4a89-b5f5-a1b2891ca3fc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:42.157672 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-6f922a1c-8562-4a89-b5f5-a1b2891ca3fc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:42.158840 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-6f922a1c-8562-4a89-b5f5-a1b2891ca3fc tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1729 microversion: 2.20 time: 0.155219 Aug 30 01:11:42.159394 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 477/965] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:42 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:43.183411 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-e6892944-6d45-40bf-b643-0a20a14d195d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:43.184109 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-e6892944-6d45-40bf-b643-0a20a14d195d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:43.190388 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e6892944-6d45-40bf-b643-0a20a14d195d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:43.190872 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e6892944-6d45-40bf-b643-0a20a14d195d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:43.191312 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e6892944-6d45-40bf-b643-0a20a14d195d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:43.192002 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e6892944-6d45-40bf-b643-0a20a14d195d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:43.192456 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e6892944-6d45-40bf-b643-0a20a14d195d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:43.192882 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e6892944-6d45-40bf-b643-0a20a14d195d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:43.322700 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-e6892944-6d45-40bf-b643-0a20a14d195d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:43.330851 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-e6892944-6d45-40bf-b643-0a20a14d195d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:43.332308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-e6892944-6d45-40bf-b643-0a20a14d195d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:43.333507 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-e6892944-6d45-40bf-b643-0a20a14d195d tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1729 microversion: 2.20 time: 0.155801 Aug 30 01:11:43.334076 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 489/966] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:43 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:44.355691 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-09e5f7c2-6d88-4fa2-bab7-90760cf9bdaf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:44.356449 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-09e5f7c2-6d88-4fa2-bab7-90760cf9bdaf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:44.363013 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-09e5f7c2-6d88-4fa2-bab7-90760cf9bdaf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:44.363491 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-09e5f7c2-6d88-4fa2-bab7-90760cf9bdaf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:44.363922 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-09e5f7c2-6d88-4fa2-bab7-90760cf9bdaf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:44.364607 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-09e5f7c2-6d88-4fa2-bab7-90760cf9bdaf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:44.365056 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-09e5f7c2-6d88-4fa2-bab7-90760cf9bdaf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:44.365498 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-09e5f7c2-6d88-4fa2-bab7-90760cf9bdaf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:44.502931 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-09e5f7c2-6d88-4fa2-bab7-90760cf9bdaf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:44.511024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-09e5f7c2-6d88-4fa2-bab7-90760cf9bdaf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:44.512463 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-09e5f7c2-6d88-4fa2-bab7-90760cf9bdaf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:44.513645 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-09e5f7c2-6d88-4fa2-bab7-90760cf9bdaf tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1716 microversion: 2.20 time: 0.161839 Aug 30 01:11:44.514192 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 478/967] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:44 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1716 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:57.563762 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-5cd4d4b5-d605-468c-a632-50d19509599e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:57.564307 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-5cd4d4b5-d605-468c-a632-50d19509599e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:57.566767 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=19 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:57.568019 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=23 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:57.574748 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5cd4d4b5-d605-468c-a632-50d19509599e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:57.575227 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5cd4d4b5-d605-468c-a632-50d19509599e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:57.575662 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5cd4d4b5-d605-468c-a632-50d19509599e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:57.576352 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5cd4d4b5-d605-468c-a632-50d19509599e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:57.576800 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5cd4d4b5-d605-468c-a632-50d19509599e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:57.577258 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-5cd4d4b5-d605-468c-a632-50d19509599e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:57.600260 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.objects.instance [None req-5cd4d4b5-d605-468c-a632-50d19509599e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lazy-loading 'flavor' on Instance uuid 77c1fad5-fcbd-475a-b590-406d1b8cfc8f {{(pid=120630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:11:57.671802 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-5cd4d4b5-d605-468c-a632-50d19509599e tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "POST /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f/action" status: 202 len: 0 microversion: 2.1 time: 0.111517 Aug 30 01:11:57.672410 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 490/968] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 30 01:11:57 2022] POST /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:11:57.680623 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-e0c36e39-f062-44ee-862f-139723cdddba tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:57.682478 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-e0c36e39-f062-44ee-862f-139723cdddba tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:57.685157 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:57.685900 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:57.691041 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e0c36e39-f062-44ee-862f-139723cdddba tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:57.691508 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e0c36e39-f062-44ee-862f-139723cdddba tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:57.691992 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e0c36e39-f062-44ee-862f-139723cdddba tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:57.692649 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e0c36e39-f062-44ee-862f-139723cdddba tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:57.693137 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e0c36e39-f062-44ee-862f-139723cdddba tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:57.693559 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-e0c36e39-f062-44ee-862f-139723cdddba tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:57.831620 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-e0c36e39-f062-44ee-862f-139723cdddba tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:57.839729 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-e0c36e39-f062-44ee-862f-139723cdddba tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1569 microversion: 2.1 time: 0.163002 Aug 30 01:11:57.840290 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 479/969] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:57 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:58.861548 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-aab76386-0102-42ae-a48c-0877be9b8604 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:58.862240 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-aab76386-0102-42ae-a48c-0877be9b8604 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:58.868864 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aab76386-0102-42ae-a48c-0877be9b8604 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:58.869366 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aab76386-0102-42ae-a48c-0877be9b8604 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:58.869806 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aab76386-0102-42ae-a48c-0877be9b8604 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:58.870501 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aab76386-0102-42ae-a48c-0877be9b8604 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:58.870933 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aab76386-0102-42ae-a48c-0877be9b8604 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:58.871353 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-aab76386-0102-42ae-a48c-0877be9b8604 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:59.001748 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-aab76386-0102-42ae-a48c-0877be9b8604 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:59.010018 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-aab76386-0102-42ae-a48c-0877be9b8604 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1569 microversion: 2.1 time: 0.152752 Aug 30 01:11:59.010577 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 491/970] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:58 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:00.031116 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-84ecdd88-a1da-4689-b651-5eb53e9c969a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:00.031724 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-84ecdd88-a1da-4689-b651-5eb53e9c969a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:00.038233 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-84ecdd88-a1da-4689-b651-5eb53e9c969a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:00.038722 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-84ecdd88-a1da-4689-b651-5eb53e9c969a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:00.039159 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-84ecdd88-a1da-4689-b651-5eb53e9c969a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:00.039868 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-84ecdd88-a1da-4689-b651-5eb53e9c969a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:00.040382 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-84ecdd88-a1da-4689-b651-5eb53e9c969a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:00.041000 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-84ecdd88-a1da-4689-b651-5eb53e9c969a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:00.177099 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-84ecdd88-a1da-4689-b651-5eb53e9c969a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:00.185516 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-84ecdd88-a1da-4689-b651-5eb53e9c969a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1569 microversion: 2.1 time: 0.158229 Aug 30 01:12:00.186097 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 480/971] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:00 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:01.207784 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-d004e896-f5fd-4377-838f-9021adfe7d2a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:01.208377 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-d004e896-f5fd-4377-838f-9021adfe7d2a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:01.215032 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d004e896-f5fd-4377-838f-9021adfe7d2a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:01.216092 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d004e896-f5fd-4377-838f-9021adfe7d2a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:01.216533 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d004e896-f5fd-4377-838f-9021adfe7d2a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:01.217259 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d004e896-f5fd-4377-838f-9021adfe7d2a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:01.217717 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d004e896-f5fd-4377-838f-9021adfe7d2a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:01.218134 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d004e896-f5fd-4377-838f-9021adfe7d2a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:01.348802 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-d004e896-f5fd-4377-838f-9021adfe7d2a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:01.356696 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-d004e896-f5fd-4377-838f-9021adfe7d2a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1569 microversion: 2.1 time: 0.152956 Aug 30 01:12:01.357291 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 492/972] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:01 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:02.377567 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-1f5536f8-87bc-4032-b188-45b62e2c062d tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:02.378186 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-1f5536f8-87bc-4032-b188-45b62e2c062d tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:02.385133 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f5536f8-87bc-4032-b188-45b62e2c062d tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:02.385625 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f5536f8-87bc-4032-b188-45b62e2c062d tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:02.386064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f5536f8-87bc-4032-b188-45b62e2c062d tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:02.386757 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f5536f8-87bc-4032-b188-45b62e2c062d tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:02.387212 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f5536f8-87bc-4032-b188-45b62e2c062d tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:02.387638 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1f5536f8-87bc-4032-b188-45b62e2c062d tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:02.520902 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-1f5536f8-87bc-4032-b188-45b62e2c062d tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:02.529305 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-1f5536f8-87bc-4032-b188-45b62e2c062d tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1569 microversion: 2.1 time: 0.155518 Aug 30 01:12:02.529873 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 481/973] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:02 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:03.550771 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-31dd0142-49f5-4168-ac0a-2bb65cb737e2 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:03.551351 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-31dd0142-49f5-4168-ac0a-2bb65cb737e2 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:03.558481 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-31dd0142-49f5-4168-ac0a-2bb65cb737e2 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:03.558966 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-31dd0142-49f5-4168-ac0a-2bb65cb737e2 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:03.559396 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-31dd0142-49f5-4168-ac0a-2bb65cb737e2 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:03.560075 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-31dd0142-49f5-4168-ac0a-2bb65cb737e2 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:03.560519 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-31dd0142-49f5-4168-ac0a-2bb65cb737e2 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:03.560936 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-31dd0142-49f5-4168-ac0a-2bb65cb737e2 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:03.935105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-31dd0142-49f5-4168-ac0a-2bb65cb737e2 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:03.942728 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-31dd0142-49f5-4168-ac0a-2bb65cb737e2 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1569 microversion: 2.1 time: 0.395910 Aug 30 01:12:03.943285 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 493/974] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:03 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1569 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:04.963863 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-9248b769-1986-47de-9f83-483369fa7b43 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:04.964595 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-9248b769-1986-47de-9f83-483369fa7b43 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:04.980766 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9248b769-1986-47de-9f83-483369fa7b43 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:04.982050 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9248b769-1986-47de-9f83-483369fa7b43 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:04.982504 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9248b769-1986-47de-9f83-483369fa7b43 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:04.983230 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9248b769-1986-47de-9f83-483369fa7b43 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:04.983689 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9248b769-1986-47de-9f83-483369fa7b43 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:04.984122 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-9248b769-1986-47de-9f83-483369fa7b43 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:05.120405 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-9248b769-1986-47de-9f83-483369fa7b43 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:05.128264 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-9248b769-1986-47de-9f83-483369fa7b43 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1569 microversion: 2.1 time: 0.168352 Aug 30 01:12:05.128829 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 482/975] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:04 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:06.149722 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-b9a71e9a-6576-4167-ba05-efbd3110c4b6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:06.150396 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-b9a71e9a-6576-4167-ba05-efbd3110c4b6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:06.157059 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b9a71e9a-6576-4167-ba05-efbd3110c4b6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:06.157565 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b9a71e9a-6576-4167-ba05-efbd3110c4b6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:06.157999 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b9a71e9a-6576-4167-ba05-efbd3110c4b6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:06.158682 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b9a71e9a-6576-4167-ba05-efbd3110c4b6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:06.159126 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b9a71e9a-6576-4167-ba05-efbd3110c4b6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:06.159543 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-b9a71e9a-6576-4167-ba05-efbd3110c4b6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:06.291408 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-b9a71e9a-6576-4167-ba05-efbd3110c4b6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:06.299124 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-b9a71e9a-6576-4167-ba05-efbd3110c4b6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1569 microversion: 2.1 time: 0.153222 Aug 30 01:12:06.299697 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 494/976] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:06 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:07.319698 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-d4e0cd5d-43b4-4c85-a6e6-95ffdad54db9 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:07.320317 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-d4e0cd5d-43b4-4c85-a6e6-95ffdad54db9 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:07.326841 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d4e0cd5d-43b4-4c85-a6e6-95ffdad54db9 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:07.327325 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d4e0cd5d-43b4-4c85-a6e6-95ffdad54db9 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:07.327760 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d4e0cd5d-43b4-4c85-a6e6-95ffdad54db9 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:07.328452 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d4e0cd5d-43b4-4c85-a6e6-95ffdad54db9 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:07.328908 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d4e0cd5d-43b4-4c85-a6e6-95ffdad54db9 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:07.329364 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-d4e0cd5d-43b4-4c85-a6e6-95ffdad54db9 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:07.459543 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-d4e0cd5d-43b4-4c85-a6e6-95ffdad54db9 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:07.468417 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-d4e0cd5d-43b4-4c85-a6e6-95ffdad54db9 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1569 microversion: 2.1 time: 0.152680 Aug 30 01:12:07.468962 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 483/977] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:07 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:08.490699 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-2f1f9b8f-666d-4d0c-84ed-2686abafdb54 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:08.491333 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-2f1f9b8f-666d-4d0c-84ed-2686abafdb54 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:08.498440 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2f1f9b8f-666d-4d0c-84ed-2686abafdb54 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:08.498930 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2f1f9b8f-666d-4d0c-84ed-2686abafdb54 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:08.499370 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2f1f9b8f-666d-4d0c-84ed-2686abafdb54 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:08.500061 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2f1f9b8f-666d-4d0c-84ed-2686abafdb54 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:08.500516 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2f1f9b8f-666d-4d0c-84ed-2686abafdb54 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:08.500947 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-2f1f9b8f-666d-4d0c-84ed-2686abafdb54 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:08.636060 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-2f1f9b8f-666d-4d0c-84ed-2686abafdb54 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:08.643758 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-2f1f9b8f-666d-4d0c-84ed-2686abafdb54 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1569 microversion: 2.1 time: 0.157054 Aug 30 01:12:08.644323 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 495/978] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:08 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:09.666061 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-8601fb07-723e-4811-afb5-c238e487d364 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:09.666690 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-8601fb07-723e-4811-afb5-c238e487d364 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:09.673279 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8601fb07-723e-4811-afb5-c238e487d364 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:09.673769 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8601fb07-723e-4811-afb5-c238e487d364 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:09.674200 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8601fb07-723e-4811-afb5-c238e487d364 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:09.674901 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8601fb07-723e-4811-afb5-c238e487d364 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:09.675358 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8601fb07-723e-4811-afb5-c238e487d364 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:09.675786 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8601fb07-723e-4811-afb5-c238e487d364 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:09.807219 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-8601fb07-723e-4811-afb5-c238e487d364 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:09.815731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-8601fb07-723e-4811-afb5-c238e487d364 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1569 microversion: 2.1 time: 0.153732 Aug 30 01:12:09.816361 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 484/979] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:09 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:10.840400 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-3a1f2086-d629-4d65-b9b5-e6b66c775f00 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:10.841017 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-3a1f2086-d629-4d65-b9b5-e6b66c775f00 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:10.848373 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3a1f2086-d629-4d65-b9b5-e6b66c775f00 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:10.848857 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3a1f2086-d629-4d65-b9b5-e6b66c775f00 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:10.849324 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3a1f2086-d629-4d65-b9b5-e6b66c775f00 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:10.850025 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3a1f2086-d629-4d65-b9b5-e6b66c775f00 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:10.850470 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3a1f2086-d629-4d65-b9b5-e6b66c775f00 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:10.851077 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-3a1f2086-d629-4d65-b9b5-e6b66c775f00 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:10.988249 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-3a1f2086-d629-4d65-b9b5-e6b66c775f00 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:10.996475 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-3a1f2086-d629-4d65-b9b5-e6b66c775f00 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1510 microversion: 2.1 time: 0.162401 Aug 30 01:12:10.996975 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 496/980] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:10 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:11.017231 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-cb5eaaff-3ed6-4104-975e-7c35fce7f53b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:12:11.017830 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-cb5eaaff-3ed6-4104-975e-7c35fce7f53b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:11.024481 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cb5eaaff-3ed6-4104-975e-7c35fce7f53b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:11.025036 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cb5eaaff-3ed6-4104-975e-7c35fce7f53b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:11.026040 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cb5eaaff-3ed6-4104-975e-7c35fce7f53b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:11.026737 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cb5eaaff-3ed6-4104-975e-7c35fce7f53b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:11.027189 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cb5eaaff-3ed6-4104-975e-7c35fce7f53b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:11.027616 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-cb5eaaff-3ed6-4104-975e-7c35fce7f53b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:11.055775 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-cb5eaaff-3ed6-4104-975e-7c35fce7f53b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120631) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 01:12:11.120252 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-cb5eaaff-3ed6-4104-975e-7c35fce7f53b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "POST /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f/action" status: 202 len: 0 microversion: 2.1 time: 0.106888 Aug 30 01:12:11.120866 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 485/981] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 30 01:12:11 2022] POST /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:12:11.129305 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-bcc6504a-d496-49f7-94dc-6755df949cb5 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:11.129932 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-bcc6504a-d496-49f7-94dc-6755df949cb5 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:11.136746 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bcc6504a-d496-49f7-94dc-6755df949cb5 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:11.137280 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bcc6504a-d496-49f7-94dc-6755df949cb5 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:11.137716 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bcc6504a-d496-49f7-94dc-6755df949cb5 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:11.138421 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bcc6504a-d496-49f7-94dc-6755df949cb5 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:11.138877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bcc6504a-d496-49f7-94dc-6755df949cb5 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:11.139303 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bcc6504a-d496-49f7-94dc-6755df949cb5 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:11.274556 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-bcc6504a-d496-49f7-94dc-6755df949cb5 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:11.282726 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-bcc6504a-d496-49f7-94dc-6755df949cb5 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1518 microversion: 2.1 time: 0.157309 Aug 30 01:12:11.283304 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 497/982] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:11 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:12.304509 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-85d414b5-cb4a-4021-963f-92a80fbc16f6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:12.305052 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-85d414b5-cb4a-4021-963f-92a80fbc16f6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:12.310991 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-85d414b5-cb4a-4021-963f-92a80fbc16f6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:12.311546 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-85d414b5-cb4a-4021-963f-92a80fbc16f6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:12.311994 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-85d414b5-cb4a-4021-963f-92a80fbc16f6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:12.313336 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-85d414b5-cb4a-4021-963f-92a80fbc16f6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:12.314001 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-85d414b5-cb4a-4021-963f-92a80fbc16f6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:12.314646 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-85d414b5-cb4a-4021-963f-92a80fbc16f6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:12.458053 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-85d414b5-cb4a-4021-963f-92a80fbc16f6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:12.466545 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-85d414b5-cb4a-4021-963f-92a80fbc16f6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1520 microversion: 2.1 time: 0.166516 Aug 30 01:12:12.467236 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 486/983] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:12 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:13.494588 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8df37e46-93a7-4e69-9cbd-096e73cb45f3 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:13.495193 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8df37e46-93a7-4e69-9cbd-096e73cb45f3 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:13.501477 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8df37e46-93a7-4e69-9cbd-096e73cb45f3 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:13.501960 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8df37e46-93a7-4e69-9cbd-096e73cb45f3 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:13.502388 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8df37e46-93a7-4e69-9cbd-096e73cb45f3 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:13.503076 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8df37e46-93a7-4e69-9cbd-096e73cb45f3 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:13.503524 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8df37e46-93a7-4e69-9cbd-096e73cb45f3 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:13.503952 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8df37e46-93a7-4e69-9cbd-096e73cb45f3 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:13.661395 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8df37e46-93a7-4e69-9cbd-096e73cb45f3 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:13.670501 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8df37e46-93a7-4e69-9cbd-096e73cb45f3 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1576 microversion: 2.1 time: 0.179672 Aug 30 01:12:13.671093 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 498/984] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:13 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:13.908955 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-d94f71c2-096c-4986-8464-76aeb46e4d8b req-1ec589e7-155e-4807-90d3-b056283095e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c1fad5-fcbd-475a-b590-406d1b8cfc8f", "name": "network-vif-unplugged", "status": "completed", "tag": "f326f1cc-3214-4c94-b458-a90b5f3ea1e3"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:12:13.919490 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-d94f71c2-096c-4986-8464-76aeb46e4d8b req-1ec589e7-155e-4807-90d3-b056283095e7 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:13.919952 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-d94f71c2-096c-4986-8464-76aeb46e4d8b req-1ec589e7-155e-4807-90d3-b056283095e7 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:13.920375 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-d94f71c2-096c-4986-8464-76aeb46e4d8b req-1ec589e7-155e-4807-90d3-b056283095e7 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:13.930937 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-d94f71c2-096c-4986-8464-76aeb46e4d8b req-1ec589e7-155e-4807-90d3-b056283095e7 service nova] Creating event network-vif-unplugged:f326f1cc-3214-4c94-b458-a90b5f3ea1e3 for instance 77c1fad5-fcbd-475a-b590-406d1b8cfc8f on hv-cinder-81514 Aug 30 01:12:13.936019 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-d94f71c2-096c-4986-8464-76aeb46e4d8b req-1ec589e7-155e-4807-90d3-b056283095e7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091316 Aug 30 01:12:13.936694 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 487/985] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:12:14.691653 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-ec7827a5-398a-4652-8c4f-2741c5819304 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:14.692303 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-ec7827a5-398a-4652-8c4f-2741c5819304 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:14.699272 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ec7827a5-398a-4652-8c4f-2741c5819304 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:14.699755 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ec7827a5-398a-4652-8c4f-2741c5819304 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:14.700192 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ec7827a5-398a-4652-8c4f-2741c5819304 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:14.700877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ec7827a5-398a-4652-8c4f-2741c5819304 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:14.701359 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ec7827a5-398a-4652-8c4f-2741c5819304 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:14.701783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ec7827a5-398a-4652-8c4f-2741c5819304 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:14.836553 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-ec7827a5-398a-4652-8c4f-2741c5819304 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:14.844595 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-ec7827a5-398a-4652-8c4f-2741c5819304 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1576 microversion: 2.1 time: 0.156808 Aug 30 01:12:14.845175 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 499/986] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:14 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:15.867520 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-65f48f3e-721b-4c9f-a364-24da4f3481a9 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:15.868213 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-65f48f3e-721b-4c9f-a364-24da4f3481a9 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:15.874992 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-65f48f3e-721b-4c9f-a364-24da4f3481a9 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:15.875468 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-65f48f3e-721b-4c9f-a364-24da4f3481a9 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:15.875899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-65f48f3e-721b-4c9f-a364-24da4f3481a9 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:15.876579 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-65f48f3e-721b-4c9f-a364-24da4f3481a9 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:15.877025 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-65f48f3e-721b-4c9f-a364-24da4f3481a9 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:15.877468 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-65f48f3e-721b-4c9f-a364-24da4f3481a9 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:16.007559 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-65f48f3e-721b-4c9f-a364-24da4f3481a9 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:16.015979 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-65f48f3e-721b-4c9f-a364-24da4f3481a9 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1576 microversion: 2.1 time: 0.153180 Aug 30 01:12:16.016545 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 488/987] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:15 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:17.036546 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-8b1d37d9-609f-4466-b3f7-a536fe39f9c7 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:17.037197 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-8b1d37d9-609f-4466-b3f7-a536fe39f9c7 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:17.044319 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8b1d37d9-609f-4466-b3f7-a536fe39f9c7 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:17.044804 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8b1d37d9-609f-4466-b3f7-a536fe39f9c7 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:17.045283 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8b1d37d9-609f-4466-b3f7-a536fe39f9c7 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:17.045982 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8b1d37d9-609f-4466-b3f7-a536fe39f9c7 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:17.046441 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8b1d37d9-609f-4466-b3f7-a536fe39f9c7 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:17.046871 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-8b1d37d9-609f-4466-b3f7-a536fe39f9c7 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:17.174862 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-8b1d37d9-609f-4466-b3f7-a536fe39f9c7 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:17.182505 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-8b1d37d9-609f-4466-b3f7-a536fe39f9c7 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1576 microversion: 2.1 time: 0.149914 Aug 30 01:12:17.183069 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 500/988] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:17 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:17.761557 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-45d62cf5-8f92-4ce2-9eee-5baa9252a57c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:17.763709 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-45d62cf5-8f92-4ce2-9eee-5baa9252a57c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:17.770106 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-45d62cf5-8f92-4ce2-9eee-5baa9252a57c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:17.770849 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-45d62cf5-8f92-4ce2-9eee-5baa9252a57c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:17.771284 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-45d62cf5-8f92-4ce2-9eee-5baa9252a57c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:17.771982 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-45d62cf5-8f92-4ce2-9eee-5baa9252a57c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:17.772436 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-45d62cf5-8f92-4ce2-9eee-5baa9252a57c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:17.772862 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-45d62cf5-8f92-4ce2-9eee-5baa9252a57c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:17.801810 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-45d62cf5-8f92-4ce2-9eee-5baa9252a57c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044659 Aug 30 01:12:17.802285 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 489/989] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 30 01:12:17 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:17.864560 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-0feda0fd-cb76-468c-b23f-95385e089c9c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:17.865060 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-0feda0fd-cb76-468c-b23f-95385e089c9c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:17.871255 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0feda0fd-cb76-468c-b23f-95385e089c9c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:17.871742 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0feda0fd-cb76-468c-b23f-95385e089c9c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:17.872181 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0feda0fd-cb76-468c-b23f-95385e089c9c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:17.872871 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0feda0fd-cb76-468c-b23f-95385e089c9c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:17.873407 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0feda0fd-cb76-468c-b23f-95385e089c9c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:17.873823 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0feda0fd-cb76-468c-b23f-95385e089c9c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:17.898795 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-0feda0fd-cb76-468c-b23f-95385e089c9c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Going to try to terminate instance {{(pid=120630) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:12:17.973859 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-0feda0fd-cb76-468c-b23f-95385e089c9c tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "DELETE /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 204 len: 0 microversion: 2.20 time: 0.112861 Aug 30 01:12:17.974902 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 501/990] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 30 01:12:17 2022] DELETE /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 01:12:17.983239 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-3c65619d-8401-4377-a296-3e88d71a0652 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:17.983867 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-3c65619d-8401-4377-a296-3e88d71a0652 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:17.989809 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3c65619d-8401-4377-a296-3e88d71a0652 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:17.990301 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3c65619d-8401-4377-a296-3e88d71a0652 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:17.990737 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3c65619d-8401-4377-a296-3e88d71a0652 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:17.991474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3c65619d-8401-4377-a296-3e88d71a0652 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:17.991907 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3c65619d-8401-4377-a296-3e88d71a0652 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:17.992336 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-3c65619d-8401-4377-a296-3e88d71a0652 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:18.126192 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3c65619d-8401-4377-a296-3e88d71a0652 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:18.134320 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3c65619d-8401-4377-a296-3e88d71a0652 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:18.135772 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-3c65619d-8401-4377-a296-3e88d71a0652 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:18.137513 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-3c65619d-8401-4377-a296-3e88d71a0652 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1722 microversion: 2.20 time: 0.158152 Aug 30 01:12:18.138072 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 490/991] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:12:17 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:12:18.203998 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-d2d2a6a7-918b-4a78-b251-ca46decb50d1 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:18.204742 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-d2d2a6a7-918b-4a78-b251-ca46decb50d1 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:18.211162 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d2d2a6a7-918b-4a78-b251-ca46decb50d1 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:18.211646 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d2d2a6a7-918b-4a78-b251-ca46decb50d1 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:18.212085 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d2d2a6a7-918b-4a78-b251-ca46decb50d1 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:18.212773 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d2d2a6a7-918b-4a78-b251-ca46decb50d1 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:18.213286 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d2d2a6a7-918b-4a78-b251-ca46decb50d1 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:18.213710 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d2d2a6a7-918b-4a78-b251-ca46decb50d1 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:18.346393 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-d2d2a6a7-918b-4a78-b251-ca46decb50d1 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:18.349928 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:18.355479 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-d2d2a6a7-918b-4a78-b251-ca46decb50d1 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1576 microversion: 2.1 time: 0.155714 Aug 30 01:12:18.356050 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 502/992] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:18 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:19.161159 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-a28c6cae-1323-4772-9443-2d5f6641bed7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:19.161797 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-a28c6cae-1323-4772-9443-2d5f6641bed7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:19.168315 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a28c6cae-1323-4772-9443-2d5f6641bed7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:19.168799 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a28c6cae-1323-4772-9443-2d5f6641bed7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:19.169269 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a28c6cae-1323-4772-9443-2d5f6641bed7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:19.169966 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a28c6cae-1323-4772-9443-2d5f6641bed7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:19.170420 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a28c6cae-1323-4772-9443-2d5f6641bed7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:19.170844 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a28c6cae-1323-4772-9443-2d5f6641bed7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:19.307153 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-a28c6cae-1323-4772-9443-2d5f6641bed7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:19.315435 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-a28c6cae-1323-4772-9443-2d5f6641bed7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:19.316897 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-a28c6cae-1323-4772-9443-2d5f6641bed7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:19.318098 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-a28c6cae-1323-4772-9443-2d5f6641bed7 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1722 microversion: 2.20 time: 0.160949 Aug 30 01:12:19.318656 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 491/993] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:12:19 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:12:19.376400 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-19bd4bc6-9330-4e63-a067-381754936934 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:19.377029 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-19bd4bc6-9330-4e63-a067-381754936934 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:19.384803 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-19bd4bc6-9330-4e63-a067-381754936934 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:19.385310 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-19bd4bc6-9330-4e63-a067-381754936934 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:19.386352 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-19bd4bc6-9330-4e63-a067-381754936934 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:19.387046 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-19bd4bc6-9330-4e63-a067-381754936934 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:19.387496 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-19bd4bc6-9330-4e63-a067-381754936934 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:19.387921 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-19bd4bc6-9330-4e63-a067-381754936934 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:19.521186 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-19bd4bc6-9330-4e63-a067-381754936934 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:19.528938 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-19bd4bc6-9330-4e63-a067-381754936934 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1576 microversion: 2.1 time: 0.157153 Aug 30 01:12:19.529519 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 503/994] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:19 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:20.342468 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-a3fba805-c5a5-40e2-aa12-368b7703b9d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:20.343144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-a3fba805-c5a5-40e2-aa12-368b7703b9d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:20.351965 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a3fba805-c5a5-40e2-aa12-368b7703b9d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:20.352139 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a3fba805-c5a5-40e2-aa12-368b7703b9d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:20.352586 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a3fba805-c5a5-40e2-aa12-368b7703b9d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:20.353343 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a3fba805-c5a5-40e2-aa12-368b7703b9d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:20.353819 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a3fba805-c5a5-40e2-aa12-368b7703b9d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:20.354270 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-a3fba805-c5a5-40e2-aa12-368b7703b9d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:20.462682 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-a3fba805-c5a5-40e2-aa12-368b7703b9d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:20.471504 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-a3fba805-c5a5-40e2-aa12-368b7703b9d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:20.472894 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-a3fba805-c5a5-40e2-aa12-368b7703b9d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:20.474199 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-a3fba805-c5a5-40e2-aa12-368b7703b9d9 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1655 microversion: 2.20 time: 0.136926 Aug 30 01:12:20.474757 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 492/995] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:12:20 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1655 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:12:20.550178 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-6eca18ea-7f34-4405-883e-ba865c13327b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:20.550883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-6eca18ea-7f34-4405-883e-ba865c13327b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:20.557445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6eca18ea-7f34-4405-883e-ba865c13327b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:20.558218 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6eca18ea-7f34-4405-883e-ba865c13327b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:20.558659 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6eca18ea-7f34-4405-883e-ba865c13327b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:20.559382 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6eca18ea-7f34-4405-883e-ba865c13327b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:20.559833 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6eca18ea-7f34-4405-883e-ba865c13327b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:20.560255 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-6eca18ea-7f34-4405-883e-ba865c13327b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:20.785676 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-6eca18ea-7f34-4405-883e-ba865c13327b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:20.795158 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-6eca18ea-7f34-4405-883e-ba865c13327b tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1576 microversion: 2.1 time: 0.248670 Aug 30 01:12:20.809691 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 504/996] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:20 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1576 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:20.843043 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-b5115da1-6ee3-481f-9e68-ad8d3eb4b060 req-c775aef6-06a7-4aa8-9ed4-c3360d73f5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7e7483-c8ec-40f2-814d-aba9573395ad", "name": "network-vif-deleted", "tag": "729c26fe-a4b3-4cc3-b9e9-2603f916a1c4"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:12:20.858834 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-b5115da1-6ee3-481f-9e68-ad8d3eb4b060 req-c775aef6-06a7-4aa8-9ed4-c3360d73f5f1 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:20.859702 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-b5115da1-6ee3-481f-9e68-ad8d3eb4b060 req-c775aef6-06a7-4aa8-9ed4-c3360d73f5f1 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:20.860593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-b5115da1-6ee3-481f-9e68-ad8d3eb4b060 req-c775aef6-06a7-4aa8-9ed4-c3360d73f5f1 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:20.873806 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-b5115da1-6ee3-481f-9e68-ad8d3eb4b060 req-c775aef6-06a7-4aa8-9ed4-c3360d73f5f1 service nova] Creating event network-vif-deleted:729c26fe-a4b3-4cc3-b9e9-2603f916a1c4 for instance aa7e7483-c8ec-40f2-814d-aba9573395ad on hv-cinder-81514 Aug 30 01:12:20.880744 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-b5115da1-6ee3-481f-9e68-ad8d3eb4b060 req-c775aef6-06a7-4aa8-9ed4-c3360d73f5f1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129058 Aug 30 01:12:20.886525 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 493/997] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:12:21.497267 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-7197ed9f-a824-4de1-881e-3e6ed79a7ac8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:21.497881 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-7197ed9f-a824-4de1-881e-3e6ed79a7ac8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:21.503905 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7197ed9f-a824-4de1-881e-3e6ed79a7ac8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:21.504391 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7197ed9f-a824-4de1-881e-3e6ed79a7ac8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:21.504825 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7197ed9f-a824-4de1-881e-3e6ed79a7ac8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:21.505546 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7197ed9f-a824-4de1-881e-3e6ed79a7ac8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:21.505997 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7197ed9f-a824-4de1-881e-3e6ed79a7ac8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:21.506423 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7197ed9f-a824-4de1-881e-3e6ed79a7ac8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:21.541754 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7197ed9f-a824-4de1-881e-3e6ed79a7ac8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:21.542236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7197ed9f-a824-4de1-881e-3e6ed79a7ac8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:21.542666 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7197ed9f-a824-4de1-881e-3e6ed79a7ac8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:21.543155 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.objects.instance [None req-7197ed9f-a824-4de1-881e-3e6ed79a7ac8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lazy-loading 'fault' on Instance uuid aa7e7483-c8ec-40f2-814d-aba9573395ad {{(pid=120630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:12:21.589130 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7197ed9f-a824-4de1-881e-3e6ed79a7ac8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:21.598730 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7197ed9f-a824-4de1-881e-3e6ed79a7ac8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:21.600213 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7197ed9f-a824-4de1-881e-3e6ed79a7ac8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff0c4a8fd8d44bda56ceeb47cd49abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54768b167b1c4fefb901f640203e1c5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:21.601411 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-7197ed9f-a824-4de1-881e-3e6ed79a7ac8 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 200 len: 1371 microversion: 2.20 time: 0.108352 Aug 30 01:12:21.602154 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 505/998] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:12:21 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 1371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:12:21.818555 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-675550d9-416a-4a09-8923-ebfa4de9f0ca tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:21.819263 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-675550d9-416a-4a09-8923-ebfa4de9f0ca tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:21.827677 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-675550d9-416a-4a09-8923-ebfa4de9f0ca tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:21.828234 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-675550d9-416a-4a09-8923-ebfa4de9f0ca tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:21.828820 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-675550d9-416a-4a09-8923-ebfa4de9f0ca tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:21.829475 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-675550d9-416a-4a09-8923-ebfa4de9f0ca tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:21.829930 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-675550d9-416a-4a09-8923-ebfa4de9f0ca tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:21.830344 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-675550d9-416a-4a09-8923-ebfa4de9f0ca tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:21.977901 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-675550d9-416a-4a09-8923-ebfa4de9f0ca tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:21.985844 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-675550d9-416a-4a09-8923-ebfa4de9f0ca tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1563 microversion: 2.1 time: 0.172740 Aug 30 01:12:21.986415 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 494/999] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:21 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:22.632414 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f944d81c-3d52-42cd-be05-c44f3693ba34 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:22.633029 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-f944d81c-3d52-42cd-be05-c44f3693ba34 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:22.639796 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f944d81c-3d52-42cd-be05-c44f3693ba34 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:22.640279 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f944d81c-3d52-42cd-be05-c44f3693ba34 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:22.640712 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f944d81c-3d52-42cd-be05-c44f3693ba34 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:22.641437 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f944d81c-3d52-42cd-be05-c44f3693ba34 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:22.641893 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f944d81c-3d52-42cd-be05-c44f3693ba34 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:22.642318 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-f944d81c-3d52-42cd-be05-c44f3693ba34 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:22.656513 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-f944d81c-3d52-42cd-be05-c44f3693ba34 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] HTTP exception thrown: Instance aa7e7483-c8ec-40f2-814d-aba9573395ad could not be found. Aug 30 01:12:22.658185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f944d81c-3d52-42cd-be05-c44f3693ba34 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Request method failure captured: Aug 30 01:12:22.658185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad HTTP/1.1 Aug 30 01:12:22.658185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:12:22.658185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:12:22.658185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:12:22.658185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:12:22.658185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:12:22.658185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:12:22.658185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:12:22.658185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:12:22.658185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWK2y6UJS-Sd2gnPMur0TECh3oo_ZLWf8EDLHuImTNankaCorLm0nFyp-S4lzxYn9lMlZ9QpLk1jIt4IQFA0MSHwXQMAn9LD9k50sfcGWLP44hfaSZxD1kJZfVgx_Er_zYODJAIRmb2VOWH7dy1A_oUtZXmbyKWob_y5YX379ER-q4o Aug 30 01:12:22.658185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:12:22.658185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:12:22.658185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:12:22.658185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:12:22.658185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:12:22.658185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:12:22.658185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:12:22.658185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: 54768b167b1c4fefb901f640203e1c5d Aug 30 01:12:22.658185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1193325301 Aug 30 01:12:22.658185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:12:22.658185 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:12:22.659956 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_54768b167b1c4fefb901f640203e1c5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/54768b167b1c4fefb901f640203e1c5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/54768b167b1c4fefb901f640203e1c5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/54768b167b1c4fefb901f640203e1c5d"}]}] Aug 30 01:12:22.659956 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1193325301 Aug 30 01:12:22.659956 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: 54768b167b1c4fefb901f640203e1c5d Aug 30 01:12:22.659956 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1193325301 Aug 30 01:12:22.659956 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-AttachVolumeShelveTestJSON-1193325301-project Aug 30 01:12:22.659956 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:12:22.659956 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:12:22.659956 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: 3ff0c4a8fd8d44bda56ceeb47cd49abf Aug 30 01:12:22.659956 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1193325301-project Aug 30 01:12:22.659956 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:12:22.659956 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Instance aa7e7483-c8ec-40f2-814d-aba9573395ad could not be found. Aug 30 01:12:22.659956 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': 'aa7e7483-c8ec-40f2-814d-aba9573395ad'} Aug 30 01:12:22.660877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:12:22.660877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:22.660877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:12:22.660877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:12:22.660877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:12:22.660877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:12:22.660877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:12:22.660877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:12:22.660877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:12:22.660877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:12:22.660877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa7e7483-c8ec-40f2-814d-aba9573395ad could not be found. Aug 30 01:12:22.660877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:12:22.660877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:12:22.660877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:12:22.660877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:22.660877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:12:22.660877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:12:22.660877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:12:22.660877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:12:22.660877 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:12:22.662520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:12:22.662520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:12:22.662520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:12:22.662520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:12:22.662520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:12:22.662520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:12:22.662520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:12:22.662520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa7e7483-c8ec-40f2-814d-aba9573395ad could not be found. Aug 30 01:12:22.662520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:12:22.662520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:12:22.662520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:12:22.662520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:22.662520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:12:22.662520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:12:22.662520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:12:22.662520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:12:22.662520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa7e7483-c8ec-40f2-814d-aba9573395ad could not be found. Aug 30 01:12:22.662520 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:12:22.663964 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-f944d81c-3d52-42cd-be05-c44f3693ba34 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Returning 404 to user: Instance aa7e7483-c8ec-40f2-814d-aba9573395ad could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:12:22.663964 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-f944d81c-3d52-42cd-be05-c44f3693ba34 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 404 len: 111 microversion: 2.20 time: 0.031111 Aug 30 01:12:22.663964 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 506/1000] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:12:22 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:12:22.669291 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-fffa65ba-e489-4f94-8eb9-61035719c236 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '.version_select at 0x7f0f5261a550>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:22.687566 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-fffa65ba-e489-4f94-8eb9-61035719c236 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1807294196" status: 204 len: 0 microversion: 2.20 time: 0.022895 Aug 30 01:12:22.688102 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 495/1001] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Aug 30 01:12:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1807294196 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 01:12:23.840969 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-4c8deb25-8be5-4f46-846e-df607d91a0a9 req-fd1bbcb9-b360-4ef1-8bfd-720e790c5391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c1fad5-fcbd-475a-b590-406d1b8cfc8f", "name": "network-vif-plugged", "status": "completed", "tag": "f326f1cc-3214-4c94-b458-a90b5f3ea1e3"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:12:23.851587 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-4c8deb25-8be5-4f46-846e-df607d91a0a9 req-fd1bbcb9-b360-4ef1-8bfd-720e790c5391 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:23.852062 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-4c8deb25-8be5-4f46-846e-df607d91a0a9 req-fd1bbcb9-b360-4ef1-8bfd-720e790c5391 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:23.852527 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-4c8deb25-8be5-4f46-846e-df607d91a0a9 req-fd1bbcb9-b360-4ef1-8bfd-720e790c5391 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:23.865331 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-4c8deb25-8be5-4f46-846e-df607d91a0a9 req-fd1bbcb9-b360-4ef1-8bfd-720e790c5391 service nova] Creating event network-vif-plugged:f326f1cc-3214-4c94-b458-a90b5f3ea1e3 for instance 77c1fad5-fcbd-475a-b590-406d1b8cfc8f on hv-cinder-81514 Aug 30 01:12:23.871390 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-4c8deb25-8be5-4f46-846e-df607d91a0a9 req-fd1bbcb9-b360-4ef1-8bfd-720e790c5391 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033617 Aug 30 01:12:23.872174 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 507/1002] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:12:24.437315 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-8824b6a7-3b35-43a1-a9e5-290030d50c44 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:24.437821 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-8824b6a7-3b35-43a1-a9e5-290030d50c44 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:24.443789 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8824b6a7-3b35-43a1-a9e5-290030d50c44 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:24.444274 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8824b6a7-3b35-43a1-a9e5-290030d50c44 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:24.444711 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8824b6a7-3b35-43a1-a9e5-290030d50c44 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:24.445436 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8824b6a7-3b35-43a1-a9e5-290030d50c44 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:24.445896 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8824b6a7-3b35-43a1-a9e5-290030d50c44 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:24.446321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8824b6a7-3b35-43a1-a9e5-290030d50c44 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:24.460195 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-8824b6a7-3b35-43a1-a9e5-290030d50c44 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] HTTP exception thrown: Instance aa7e7483-c8ec-40f2-814d-aba9573395ad could not be found. Aug 30 01:12:24.461898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-8824b6a7-3b35-43a1-a9e5-290030d50c44 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Request method failure captured: Aug 30 01:12:24.461898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: DELETE /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad HTTP/1.1 Aug 30 01:12:24.461898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:12:24.461898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:12:24.461898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:12:24.461898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:12:24.461898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:12:24.461898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:12:24.461898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:12:24.461898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:12:24.461898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWK2y6UJS-Sd2gnPMur0TECh3oo_ZLWf8EDLHuImTNankaCorLm0nFyp-S4lzxYn9lMlZ9QpLk1jIt4IQFA0MSHwXQMAn9LD9k50sfcGWLP44hfaSZxD1kJZfVgx_Er_zYODJAIRmb2VOWH7dy1A_oUtZXmbyKWob_y5YX379ER-q4o Aug 30 01:12:24.461898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:12:24.461898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:12:24.461898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:12:24.461898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:12:24.461898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:12:24.461898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:12:24.461898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:12:24.461898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: 54768b167b1c4fefb901f640203e1c5d Aug 30 01:12:24.461898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1193325301 Aug 30 01:12:24.461898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:12:24.461898 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:12:24.463556 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_54768b167b1c4fefb901f640203e1c5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/54768b167b1c4fefb901f640203e1c5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/54768b167b1c4fefb901f640203e1c5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/54768b167b1c4fefb901f640203e1c5d"}]}] Aug 30 01:12:24.463556 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1193325301 Aug 30 01:12:24.463556 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: 54768b167b1c4fefb901f640203e1c5d Aug 30 01:12:24.463556 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1193325301 Aug 30 01:12:24.463556 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-AttachVolumeShelveTestJSON-1193325301-project Aug 30 01:12:24.463556 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:12:24.463556 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:12:24.463556 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: 3ff0c4a8fd8d44bda56ceeb47cd49abf Aug 30 01:12:24.463556 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1193325301-project Aug 30 01:12:24.463556 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:12:24.463556 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Instance aa7e7483-c8ec-40f2-814d-aba9573395ad could not be found. Aug 30 01:12:24.463556 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': 'aa7e7483-c8ec-40f2-814d-aba9573395ad'} Aug 30 01:12:24.465171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:12:24.465171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:24.465171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:12:24.465171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:12:24.465171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:12:24.465171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:12:24.465171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:12:24.465171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:12:24.465171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:12:24.465171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:12:24.465171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa7e7483-c8ec-40f2-814d-aba9573395ad could not be found. Aug 30 01:12:24.465171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:12:24.465171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:12:24.465171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:12:24.465171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:24.465171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:12:24.465171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:12:24.465171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:12:24.465171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:12:24.465171 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:12:24.466750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:12:24.466750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:12:24.466750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:12:24.466750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:12:24.466750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:12:24.466750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:12:24.466750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:12:24.466750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:12:24.466750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:12:24.466750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa7e7483-c8ec-40f2-814d-aba9573395ad could not be found. Aug 30 01:12:24.466750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:12:24.466750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:12:24.466750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:12:24.466750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:24.466750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:12:24.466750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:12:24.466750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:12:24.466750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:12:24.466750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa7e7483-c8ec-40f2-814d-aba9573395ad could not be found. Aug 30 01:12:24.466750 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:12:24.468321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-8824b6a7-3b35-43a1-a9e5-290030d50c44 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Returning 404 to user: Instance aa7e7483-c8ec-40f2-814d-aba9573395ad could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:12:24.468321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-8824b6a7-3b35-43a1-a9e5-290030d50c44 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "DELETE /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 404 len: 111 microversion: 2.20 time: 0.030628 Aug 30 01:12:24.468321 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 496/1003] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 30 01:12:24 2022] DELETE /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:12:24.473024 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-d089e611-baf7-447f-8416-2e282ec20c80 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:24.473749 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-d089e611-baf7-447f-8416-2e282ec20c80 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: aa7e7483-c8ec-40f2-814d-aba9573395ad] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:24.480162 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d089e611-baf7-447f-8416-2e282ec20c80 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:24.480651 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d089e611-baf7-447f-8416-2e282ec20c80 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:24.481107 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d089e611-baf7-447f-8416-2e282ec20c80 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:24.481807 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d089e611-baf7-447f-8416-2e282ec20c80 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:24.482268 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d089e611-baf7-447f-8416-2e282ec20c80 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:24.482699 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d089e611-baf7-447f-8416-2e282ec20c80 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:24.496397 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-d089e611-baf7-447f-8416-2e282ec20c80 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] HTTP exception thrown: Instance aa7e7483-c8ec-40f2-814d-aba9573395ad could not be found. Aug 30 01:12:24.498105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-d089e611-baf7-447f-8416-2e282ec20c80 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Request method failure captured: Aug 30 01:12:24.498105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad HTTP/1.1 Aug 30 01:12:24.498105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:12:24.498105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:12:24.498105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:12:24.498105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:12:24.498105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:12:24.498105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:12:24.498105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:12:24.498105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:12:24.498105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWK2y6UJS-Sd2gnPMur0TECh3oo_ZLWf8EDLHuImTNankaCorLm0nFyp-S4lzxYn9lMlZ9QpLk1jIt4IQFA0MSHwXQMAn9LD9k50sfcGWLP44hfaSZxD1kJZfVgx_Er_zYODJAIRmb2VOWH7dy1A_oUtZXmbyKWob_y5YX379ER-q4o Aug 30 01:12:24.498105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:12:24.498105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:12:24.498105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:12:24.498105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:12:24.498105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:12:24.498105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:12:24.498105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:12:24.498105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: 54768b167b1c4fefb901f640203e1c5d Aug 30 01:12:24.498105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1193325301 Aug 30 01:12:24.498105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:12:24.498105 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:12:24.499781 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_54768b167b1c4fefb901f640203e1c5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/54768b167b1c4fefb901f640203e1c5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/54768b167b1c4fefb901f640203e1c5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/54768b167b1c4fefb901f640203e1c5d"}]}] Aug 30 01:12:24.499781 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1193325301 Aug 30 01:12:24.499781 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: 54768b167b1c4fefb901f640203e1c5d Aug 30 01:12:24.499781 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1193325301 Aug 30 01:12:24.499781 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-AttachVolumeShelveTestJSON-1193325301-project Aug 30 01:12:24.499781 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:12:24.499781 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:12:24.499781 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: 3ff0c4a8fd8d44bda56ceeb47cd49abf Aug 30 01:12:24.499781 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1193325301-project Aug 30 01:12:24.499781 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:12:24.499781 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Instance aa7e7483-c8ec-40f2-814d-aba9573395ad could not be found. Aug 30 01:12:24.499781 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': 'aa7e7483-c8ec-40f2-814d-aba9573395ad'} Aug 30 01:12:24.500937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:12:24.500937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:24.500937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:12:24.500937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:12:24.500937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:12:24.500937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:12:24.500937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:12:24.500937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:12:24.500937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:12:24.500937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:12:24.500937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa7e7483-c8ec-40f2-814d-aba9573395ad could not be found. Aug 30 01:12:24.500937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:12:24.500937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:12:24.500937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:12:24.500937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:24.500937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:12:24.500937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:12:24.500937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:12:24.500937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:12:24.500937 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:12:24.502429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:12:24.502429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:12:24.502429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:12:24.502429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:12:24.502429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:12:24.502429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:12:24.502429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:12:24.502429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa7e7483-c8ec-40f2-814d-aba9573395ad could not be found. Aug 30 01:12:24.502429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:12:24.502429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:12:24.502429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:12:24.502429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:24.502429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:12:24.502429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:12:24.502429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:12:24.502429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:12:24.502429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa7e7483-c8ec-40f2-814d-aba9573395ad could not be found. Aug 30 01:12:24.502429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:12:24.503827 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-d089e611-baf7-447f-8416-2e282ec20c80 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Returning 404 to user: Instance aa7e7483-c8ec-40f2-814d-aba9573395ad could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:12:24.503827 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-d089e611-baf7-447f-8416-2e282ec20c80 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad" status: 404 len: 111 microversion: 2.20 time: 0.030681 Aug 30 01:12:24.503827 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 508/1004] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:12:24 2022] GET /compute/v2.1/servers/aa7e7483-c8ec-40f2-814d-aba9573395ad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:12:25.635213 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-31c35798-be04-4dac-b830-e16eac7edfa5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:25.635714 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-31c35798-be04-4dac-b830-e16eac7edfa5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:25.642048 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-31c35798-be04-4dac-b830-e16eac7edfa5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:25.642575 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-31c35798-be04-4dac-b830-e16eac7edfa5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:25.643045 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-31c35798-be04-4dac-b830-e16eac7edfa5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:25.643777 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-31c35798-be04-4dac-b830-e16eac7edfa5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:25.644227 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-31c35798-be04-4dac-b830-e16eac7edfa5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:25.644648 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-31c35798-be04-4dac-b830-e16eac7edfa5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:25.658532 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.wsgi [None req-31c35798-be04-4dac-b830-e16eac7edfa5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] HTTP exception thrown: Instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 could not be found. Aug 30 01:12:25.660064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-31c35798-be04-4dac-b830-e16eac7edfa5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Request method failure captured: Aug 30 01:12:25.660064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: request: DELETE /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 HTTP/1.1 Aug 30 01:12:25.660064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept: application/json Aug 30 01:12:25.660064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Accept-Encoding: identity Aug 30 01:12:25.660064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Connection: close Aug 30 01:12:25.660064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Length: 0 Aug 30 01:12:25.660064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Content-Type: application/json Aug 30 01:12:25.660064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Host: 10.222.0.78 Aug 30 01:12:25.660064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: Openstack-System-Scope: None Aug 30 01:12:25.660064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: User-Agent: python-urllib3/1.26.12 Aug 30 01:12:25.660064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Auth-Token: gAAAAABjDWK2y6UJS-Sd2gnPMur0TECh3oo_ZLWf8EDLHuImTNankaCorLm0nFyp-S4lzxYn9lMlZ9QpLk1jIt4IQFA0MSHwXQMAn9LD9k50sfcGWLP44hfaSZxD1kJZfVgx_Er_zYODJAIRmb2VOWH7dy1A_oUtZXmbyKWob_y5YX379ER-q4o Aug 30 01:12:25.660064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Id: None Aug 30 01:12:25.660064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Domain-Name: None Aug 30 01:12:25.660064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Identity-Status: Confirmed Aug 30 01:12:25.660064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Is-Admin-Project: True Aug 30 01:12:25.660064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:12:25.660064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Id: default Aug 30 01:12:25.660064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Domain-Name: Default Aug 30 01:12:25.660064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Id: 54768b167b1c4fefb901f640203e1c5d Aug 30 01:12:25.660064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1193325301 Aug 30 01:12:25.660064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Role: reader,member Aug 30 01:12:25.660064 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Roles: reader,member Aug 30 01:12:25.661728 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_54768b167b1c4fefb901f640203e1c5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/54768b167b1c4fefb901f640203e1c5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/54768b167b1c4fefb901f640203e1c5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/54768b167b1c4fefb901f640203e1c5d"}]}] Aug 30 01:12:25.661728 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1193325301 Aug 30 01:12:25.661728 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Id: 54768b167b1c4fefb901f640203e1c5d Aug 30 01:12:25.661728 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1193325301 Aug 30 01:12:25.661728 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User: tempest-AttachVolumeShelveTestJSON-1193325301-project Aug 30 01:12:25.661728 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Id: default Aug 30 01:12:25.661728 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Domain-Name: Default Aug 30 01:12:25.661728 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Id: 3ff0c4a8fd8d44bda56ceeb47cd49abf Aug 30 01:12:25.661728 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1193325301-project Aug 30 01:12:25.661728 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: method: > Aug 30 01:12:25.661728 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: exception: Instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 could not be found. Aug 30 01:12:25.661728 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: action_args: {'id': '8f9b5386-7fbc-4d22-a388-55c656bf9255'} Aug 30 01:12:25.662823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:12:25.662823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:25.662823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:12:25.662823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:12:25.662823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:12:25.662823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:12:25.662823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:12:25.662823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:12:25.662823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:12:25.662823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:12:25.662823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 could not be found. Aug 30 01:12:25.662823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:12:25.662823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:12:25.662823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:12:25.662823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:25.662823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:12:25.662823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:12:25.662823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:12:25.662823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:12:25.662823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:12:25.664400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:12:25.664400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:12:25.664400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:12:25.664400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:12:25.664400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:12:25.664400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:12:25.664400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:12:25.664400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:12:25.664400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:12:25.664400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 could not be found. Aug 30 01:12:25.664400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:12:25.664400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:12:25.664400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:12:25.664400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:25.664400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:12:25.664400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:12:25.664400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:12:25.664400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:12:25.664400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 could not be found. Aug 30 01:12:25.664400 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: ERROR nova.api.openstack.wsgi Aug 30 01:12:25.666017 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-31c35798-be04-4dac-b830-e16eac7edfa5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Returning 404 to user: Instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 could not be found. {{(pid=120631) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:12:25.666017 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-31c35798-be04-4dac-b830-e16eac7edfa5 tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 404 len: 111 microversion: 2.20 time: 0.030090 Aug 30 01:12:25.666017 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 497/1005] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 30 01:12:25 2022] DELETE /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:12:25.670911 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-0cfff43d-19aa-4472-8929-d946cde2fb9a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:25.671534 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-0cfff43d-19aa-4472-8929-d946cde2fb9a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] [instance: 8f9b5386-7fbc-4d22-a388-55c656bf9255] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:25.678020 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0cfff43d-19aa-4472-8929-d946cde2fb9a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:25.678510 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0cfff43d-19aa-4472-8929-d946cde2fb9a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:25.678954 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0cfff43d-19aa-4472-8929-d946cde2fb9a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:25.679652 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0cfff43d-19aa-4472-8929-d946cde2fb9a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:25.680111 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0cfff43d-19aa-4472-8929-d946cde2fb9a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:25.680541 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0cfff43d-19aa-4472-8929-d946cde2fb9a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:25.694602 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-0cfff43d-19aa-4472-8929-d946cde2fb9a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] HTTP exception thrown: Instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 could not be found. Aug 30 01:12:25.696141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-0cfff43d-19aa-4472-8929-d946cde2fb9a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Request method failure captured: Aug 30 01:12:25.696141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 HTTP/1.1 Aug 30 01:12:25.696141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:12:25.696141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:12:25.696141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:12:25.696141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:12:25.696141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:12:25.696141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:12:25.696141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:12:25.696141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:12:25.696141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWK2y6UJS-Sd2gnPMur0TECh3oo_ZLWf8EDLHuImTNankaCorLm0nFyp-S4lzxYn9lMlZ9QpLk1jIt4IQFA0MSHwXQMAn9LD9k50sfcGWLP44hfaSZxD1kJZfVgx_Er_zYODJAIRmb2VOWH7dy1A_oUtZXmbyKWob_y5YX379ER-q4o Aug 30 01:12:25.696141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:12:25.696141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:12:25.696141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:12:25.696141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:12:25.696141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:12:25.696141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:12:25.696141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:12:25.696141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: 54768b167b1c4fefb901f640203e1c5d Aug 30 01:12:25.696141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1193325301 Aug 30 01:12:25.696141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:12:25.696141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:12:25.697783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_54768b167b1c4fefb901f640203e1c5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/54768b167b1c4fefb901f640203e1c5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/54768b167b1c4fefb901f640203e1c5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/54768b167b1c4fefb901f640203e1c5d"}]}] Aug 30 01:12:25.697783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1193325301 Aug 30 01:12:25.697783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: 54768b167b1c4fefb901f640203e1c5d Aug 30 01:12:25.697783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1193325301 Aug 30 01:12:25.697783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-AttachVolumeShelveTestJSON-1193325301-project Aug 30 01:12:25.697783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:12:25.697783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:12:25.697783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: 3ff0c4a8fd8d44bda56ceeb47cd49abf Aug 30 01:12:25.697783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1193325301-project Aug 30 01:12:25.697783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:12:25.697783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 could not be found. Aug 30 01:12:25.697783 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': '8f9b5386-7fbc-4d22-a388-55c656bf9255'} Aug 30 01:12:25.698797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:12:25.698797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:25.698797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:12:25.698797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:12:25.698797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:12:25.698797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:12:25.698797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:12:25.698797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:12:25.698797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:12:25.698797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:12:25.698797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 could not be found. Aug 30 01:12:25.698797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:12:25.698797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:12:25.698797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:12:25.698797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:25.698797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:12:25.698797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:12:25.698797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:12:25.698797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:12:25.698797 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:12:25.700138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:12:25.700138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:12:25.700138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:12:25.700138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:12:25.700138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:12:25.700138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:12:25.700138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:12:25.700138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 could not be found. Aug 30 01:12:25.700138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:12:25.700138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:12:25.700138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:12:25.700138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:25.700138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:12:25.700138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:12:25.700138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:12:25.700138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:12:25.700138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 could not be found. Aug 30 01:12:25.700138 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:12:25.701285 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-0cfff43d-19aa-4472-8929-d946cde2fb9a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] Returning 404 to user: Instance 8f9b5386-7fbc-4d22-a388-55c656bf9255 could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:12:25.701285 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-0cfff43d-19aa-4472-8929-d946cde2fb9a tempest-AttachVolumeShelveTestJSON-1193325301 tempest-AttachVolumeShelveTestJSON-1193325301-project] 10.222.0.78 "GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255" status: 404 len: 111 microversion: 2.20 time: 0.031436 Aug 30 01:12:25.701285 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 509/1006] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 30 01:12:25 2022] GET /compute/v2.1/servers/8f9b5386-7fbc-4d22-a388-55c656bf9255 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:13:17.468395 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-ec052f6d-21c7-4ef5-9b8a-4f06e5154148 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1342681018", "imageRef": "d6c817b5-c41c-4210-a963-172386e2e582", "flavorRef": "452", "networks": [{"uuid": "c5fbd515-25c8-49cc-a7b1-48bf5db47f27"}]}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:17.477227 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:17.477865 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:17.528501 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.network.neutron [None req-ec052f6d-21c7-4ef5-9b8a-4f06e5154148 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] validate_networks() for [('c5fbd515-25c8-49cc-a7b1-48bf5db47f27', None, None, None, None, None)] {{(pid=120631) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:13:17.931079 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-ec052f6d-21c7-4ef5-9b8a-4f06e5154148 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Flavor limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:13:17.931530 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-ec052f6d-21c7-4ef5-9b8a-4f06e5154148 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Image limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:13:17.931998 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-ec052f6d-21c7-4ef5-9b8a-4f06e5154148 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Flavor pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:13:17.932458 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-ec052f6d-21c7-4ef5-9b8a-4f06e5154148 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Image pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:13:17.932865 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-ec052f6d-21c7-4ef5-9b8a-4f06e5154148 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:13:17.942373 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ec052f6d-21c7-4ef5-9b8a-4f06e5154148 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:17.942846 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ec052f6d-21c7-4ef5-9b8a-4f06e5154148 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:17.943275 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ec052f6d-21c7-4ef5-9b8a-4f06e5154148 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:17.943989 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ec052f6d-21c7-4ef5-9b8a-4f06e5154148 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:17.944436 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ec052f6d-21c7-4ef5-9b8a-4f06e5154148 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:17.944853 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-ec052f6d-21c7-4ef5-9b8a-4f06e5154148 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:17.961587 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-ec052f6d-21c7-4ef5-9b8a-4f06e5154148 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Getting quotas for project 0fc156b7a56e4ecc999a85d59bd008b3. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:13:17.965421 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-ec052f6d-21c7-4ef5-9b8a-4f06e5154148 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Getting quotas for user 1df3f20605ad4ccfaefddb64cec11875 and project 0fc156b7a56e4ecc999a85d59bd008b3. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:13:17.975777 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-ec052f6d-21c7-4ef5-9b8a-4f06e5154148 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Going to run 1 instances... {{(pid=120631) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:13:17.978060 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-ec052f6d-21c7-4ef5-9b8a-4f06e5154148 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6c817b5-c41c-4210-a963-172386e2e582',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120631) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:13:18.024828 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-ec052f6d-21c7-4ef5-9b8a-4f06e5154148 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560948 Aug 30 01:13:18.025817 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 498/1007] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 30 01:13:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:13:18.036320 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-6ea576b5-04d8-43c0-b172-fea02861bd36 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:18.036935 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-6ea576b5-04d8-43c0-b172-fea02861bd36 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:18.040029 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:18.040919 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=28 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:18.096935 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-6ea576b5-04d8-43c0-b172-fea02861bd36 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:18.104107 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-6ea576b5-04d8-43c0-b172-fea02861bd36 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd" status: 200 len: 1219 microversion: 2.1 time: 0.071547 Aug 30 01:13:18.104670 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 510/1008] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:18 2022] GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:13:19.125586 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-238d4a3f-851f-455a-8b04-826e877d4908 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:19.126299 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-238d4a3f-851f-455a-8b04-826e877d4908 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:19.133329 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-238d4a3f-851f-455a-8b04-826e877d4908 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:19.133816 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-238d4a3f-851f-455a-8b04-826e877d4908 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:19.134250 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-238d4a3f-851f-455a-8b04-826e877d4908 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:19.134949 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-238d4a3f-851f-455a-8b04-826e877d4908 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:19.135451 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-238d4a3f-851f-455a-8b04-826e877d4908 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:19.135880 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-238d4a3f-851f-455a-8b04-826e877d4908 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:19.209563 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-238d4a3f-851f-455a-8b04-826e877d4908 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:19.219105 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-238d4a3f-851f-455a-8b04-826e877d4908 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd" status: 200 len: 1277 microversion: 2.1 time: 0.098547 Aug 30 01:13:19.219690 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 499/1009] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:19 2022] GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:20.240486 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-4960eb6f-e41e-48dd-8e93-fad4f49ed9ab tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:20.241123 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-4960eb6f-e41e-48dd-8e93-fad4f49ed9ab tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:20.248538 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4960eb6f-e41e-48dd-8e93-fad4f49ed9ab tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:20.249051 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4960eb6f-e41e-48dd-8e93-fad4f49ed9ab tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:20.249497 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4960eb6f-e41e-48dd-8e93-fad4f49ed9ab tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:20.250402 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4960eb6f-e41e-48dd-8e93-fad4f49ed9ab tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:20.250932 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4960eb6f-e41e-48dd-8e93-fad4f49ed9ab tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:20.251281 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-4960eb6f-e41e-48dd-8e93-fad4f49ed9ab tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:20.284257 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-3608fec5-2242-4556-a8f9-2f1c214387e2 req-cb2fac86-2a2c-498f-9cd3-115b0e31e720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd", "tag": "c6bd4d4e-a659-4ec2-9e93-0883fee5477e"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:20.296485 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-3608fec5-2242-4556-a8f9-2f1c214387e2 req-cb2fac86-2a2c-498f-9cd3-115b0e31e720 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:20.297285 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-3608fec5-2242-4556-a8f9-2f1c214387e2 req-cb2fac86-2a2c-498f-9cd3-115b0e31e720 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:20.297905 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-3608fec5-2242-4556-a8f9-2f1c214387e2 req-cb2fac86-2a2c-498f-9cd3-115b0e31e720 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:20.311283 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-3608fec5-2242-4556-a8f9-2f1c214387e2 req-cb2fac86-2a2c-498f-9cd3-115b0e31e720 service nova] Creating event network-changed:c6bd4d4e-a659-4ec2-9e93-0883fee5477e for instance d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd on hv-cinder-81514 Aug 30 01:13:20.316319 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-3608fec5-2242-4556-a8f9-2f1c214387e2 req-cb2fac86-2a2c-498f-9cd3-115b0e31e720 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038081 Aug 30 01:13:20.317210 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 500/1010] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:13:20.540998 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-4960eb6f-e41e-48dd-8e93-fad4f49ed9ab tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:20.548847 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-4960eb6f-e41e-48dd-8e93-fad4f49ed9ab tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd" status: 200 len: 1319 microversion: 2.1 time: 0.312144 Aug 30 01:13:20.549581 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 511/1011] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:20 2022] GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:21.571087 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-299cd6b2-19a2-4c91-9765-85601f9cd3b5 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:21.571823 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-299cd6b2-19a2-4c91-9765-85601f9cd3b5 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:21.578344 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-299cd6b2-19a2-4c91-9765-85601f9cd3b5 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:21.578834 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-299cd6b2-19a2-4c91-9765-85601f9cd3b5 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:21.579272 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-299cd6b2-19a2-4c91-9765-85601f9cd3b5 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:21.579977 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-299cd6b2-19a2-4c91-9765-85601f9cd3b5 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:21.580433 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-299cd6b2-19a2-4c91-9765-85601f9cd3b5 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:21.580862 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-299cd6b2-19a2-4c91-9765-85601f9cd3b5 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:21.792816 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-299cd6b2-19a2-4c91-9765-85601f9cd3b5 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:21.803555 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-299cd6b2-19a2-4c91-9765-85601f9cd3b5 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd" status: 200 len: 1319 microversion: 2.1 time: 0.237093 Aug 30 01:13:21.804230 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 501/1012] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:21 2022] GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:22.825568 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-07361f34-9ad4-47b3-af56-aef248775cd2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:22.826090 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-07361f34-9ad4-47b3-af56-aef248775cd2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:22.832591 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-07361f34-9ad4-47b3-af56-aef248775cd2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:22.833095 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-07361f34-9ad4-47b3-af56-aef248775cd2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:22.833538 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-07361f34-9ad4-47b3-af56-aef248775cd2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:22.834223 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-07361f34-9ad4-47b3-af56-aef248775cd2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:22.834673 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-07361f34-9ad4-47b3-af56-aef248775cd2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:22.835094 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-07361f34-9ad4-47b3-af56-aef248775cd2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:22.964030 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-07361f34-9ad4-47b3-af56-aef248775cd2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:22.972011 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-07361f34-9ad4-47b3-af56-aef248775cd2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd" status: 200 len: 1319 microversion: 2.1 time: 0.150840 Aug 30 01:13:22.972571 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 512/1013] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:22 2022] GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:23.992897 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-5aa57bb7-8d63-4cd9-b466-aa9d98863e64 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:23.993608 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-5aa57bb7-8d63-4cd9-b466-aa9d98863e64 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:24.001230 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5aa57bb7-8d63-4cd9-b466-aa9d98863e64 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:24.001762 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5aa57bb7-8d63-4cd9-b466-aa9d98863e64 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:24.002200 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5aa57bb7-8d63-4cd9-b466-aa9d98863e64 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:24.002910 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5aa57bb7-8d63-4cd9-b466-aa9d98863e64 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:24.003367 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5aa57bb7-8d63-4cd9-b466-aa9d98863e64 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:24.003797 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5aa57bb7-8d63-4cd9-b466-aa9d98863e64 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:24.138885 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-5aa57bb7-8d63-4cd9-b466-aa9d98863e64 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:24.148618 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-5aa57bb7-8d63-4cd9-b466-aa9d98863e64 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd" status: 200 len: 1319 microversion: 2.1 time: 0.159611 Aug 30 01:13:24.149404 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 502/1014] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:23 2022] GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:25.170914 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-7bb4b51c-ffc1-40a2-8d9b-39ab65957597 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:25.171527 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-7bb4b51c-ffc1-40a2-8d9b-39ab65957597 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:25.178025 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7bb4b51c-ffc1-40a2-8d9b-39ab65957597 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:25.178509 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7bb4b51c-ffc1-40a2-8d9b-39ab65957597 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:25.178948 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7bb4b51c-ffc1-40a2-8d9b-39ab65957597 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:25.179643 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7bb4b51c-ffc1-40a2-8d9b-39ab65957597 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:25.180098 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7bb4b51c-ffc1-40a2-8d9b-39ab65957597 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:25.180524 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-7bb4b51c-ffc1-40a2-8d9b-39ab65957597 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:25.315723 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-7bb4b51c-ffc1-40a2-8d9b-39ab65957597 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:25.323274 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-7bb4b51c-ffc1-40a2-8d9b-39ab65957597 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd" status: 200 len: 1319 microversion: 2.1 time: 0.156882 Aug 30 01:13:25.323831 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 513/1015] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:25 2022] GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:26.125069 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-4f5e384e-7896-4e95-9e85-2a4e62b6c4ea req-dc373e48-26ac-4c10-a3f7-460fabb6bc21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd", "name": "network-vif-plugged", "status": "completed", "tag": "c6bd4d4e-a659-4ec2-9e93-0883fee5477e"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:26.135182 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-4f5e384e-7896-4e95-9e85-2a4e62b6c4ea req-dc373e48-26ac-4c10-a3f7-460fabb6bc21 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:26.135662 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-4f5e384e-7896-4e95-9e85-2a4e62b6c4ea req-dc373e48-26ac-4c10-a3f7-460fabb6bc21 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:26.136114 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-4f5e384e-7896-4e95-9e85-2a4e62b6c4ea req-dc373e48-26ac-4c10-a3f7-460fabb6bc21 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:26.148207 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-4f5e384e-7896-4e95-9e85-2a4e62b6c4ea req-dc373e48-26ac-4c10-a3f7-460fabb6bc21 service nova] Creating event network-vif-plugged:c6bd4d4e-a659-4ec2-9e93-0883fee5477e for instance d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd on hv-cinder-81514 Aug 30 01:13:26.153968 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-4f5e384e-7896-4e95-9e85-2a4e62b6c4ea req-dc373e48-26ac-4c10-a3f7-460fabb6bc21 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032162 Aug 30 01:13:26.154555 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 503/1016] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:13:26.343614 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-872635f4-8255-46a3-9914-36e43dffb589 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:26.344238 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-872635f4-8255-46a3-9914-36e43dffb589 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:26.350369 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-872635f4-8255-46a3-9914-36e43dffb589 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:26.352056 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-872635f4-8255-46a3-9914-36e43dffb589 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:26.352484 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-872635f4-8255-46a3-9914-36e43dffb589 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:26.353268 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-872635f4-8255-46a3-9914-36e43dffb589 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:26.353906 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-872635f4-8255-46a3-9914-36e43dffb589 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:26.354152 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-872635f4-8255-46a3-9914-36e43dffb589 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:26.487579 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-872635f4-8255-46a3-9914-36e43dffb589 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:26.495101 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-872635f4-8255-46a3-9914-36e43dffb589 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd" status: 200 len: 1319 microversion: 2.1 time: 0.155307 Aug 30 01:13:26.495669 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 514/1017] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:26 2022] GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:27.517380 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-8c075464-76a9-4581-bdd9-bd8ecaa13118 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:27.518007 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-8c075464-76a9-4581-bdd9-bd8ecaa13118 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:27.524383 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8c075464-76a9-4581-bdd9-bd8ecaa13118 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:27.524867 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8c075464-76a9-4581-bdd9-bd8ecaa13118 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:27.525334 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8c075464-76a9-4581-bdd9-bd8ecaa13118 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:27.526032 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8c075464-76a9-4581-bdd9-bd8ecaa13118 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:27.526486 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8c075464-76a9-4581-bdd9-bd8ecaa13118 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:27.526915 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8c075464-76a9-4581-bdd9-bd8ecaa13118 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:27.657170 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-8c075464-76a9-4581-bdd9-bd8ecaa13118 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:27.665391 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-8c075464-76a9-4581-bdd9-bd8ecaa13118 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd" status: 200 len: 1319 microversion: 2.1 time: 0.153405 Aug 30 01:13:27.665963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 504/1018] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:27 2022] GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:28.687291 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-209d1062-32ad-4300-ac38-c30c79a5bdce tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:28.687899 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-209d1062-32ad-4300-ac38-c30c79a5bdce tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:28.690273 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=2 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:28.695615 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-209d1062-32ad-4300-ac38-c30c79a5bdce tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:28.696101 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-209d1062-32ad-4300-ac38-c30c79a5bdce tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:28.696558 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-209d1062-32ad-4300-ac38-c30c79a5bdce tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:28.697294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-209d1062-32ad-4300-ac38-c30c79a5bdce tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:28.697744 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-209d1062-32ad-4300-ac38-c30c79a5bdce tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:28.698166 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-209d1062-32ad-4300-ac38-c30c79a5bdce tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:28.855573 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-209d1062-32ad-4300-ac38-c30c79a5bdce tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:28.863380 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-209d1062-32ad-4300-ac38-c30c79a5bdce tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd" status: 200 len: 1508 microversion: 2.1 time: 0.180947 Aug 30 01:13:28.863945 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 515/1019] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:28 2022] GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:43.079173 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-5fe28e87-3e94-40f5-90db-8396074e97c6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:43.079740 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-5fe28e87-3e94-40f5-90db-8396074e97c6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:43.081435 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-e37fe3fa-5a86-4142-beca-9b9a05a505e9 req-f059a2fe-362c-4ce6-862c-aa35c15de0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77c1fad5-fcbd-475a-b590-406d1b8cfc8f", "tag": "f326f1cc-3214-4c94-b458-a90b5f3ea1e3"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:43.081910 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=2 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:43.082721 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=6 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:43.083456 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:43.084581 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=30 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:43.089050 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=14 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:43.090931 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=30 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:43.091671 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5fe28e87-3e94-40f5-90db-8396074e97c6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:43.092288 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5fe28e87-3e94-40f5-90db-8396074e97c6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:43.093040 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5fe28e87-3e94-40f5-90db-8396074e97c6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:43.093965 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-e37fe3fa-5a86-4142-beca-9b9a05a505e9 req-f059a2fe-362c-4ce6-862c-aa35c15de0a6 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:43.094104 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5fe28e87-3e94-40f5-90db-8396074e97c6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:43.094444 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-e37fe3fa-5a86-4142-beca-9b9a05a505e9 req-f059a2fe-362c-4ce6-862c-aa35c15de0a6 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:43.094906 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-e37fe3fa-5a86-4142-beca-9b9a05a505e9 req-f059a2fe-362c-4ce6-862c-aa35c15de0a6 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:43.095029 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5fe28e87-3e94-40f5-90db-8396074e97c6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:43.095549 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5fe28e87-3e94-40f5-90db-8396074e97c6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:43.109399 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-e37fe3fa-5a86-4142-beca-9b9a05a505e9 req-f059a2fe-362c-4ce6-862c-aa35c15de0a6 service nova] Creating event network-changed:f326f1cc-3214-4c94-b458-a90b5f3ea1e3 for instance 77c1fad5-fcbd-475a-b590-406d1b8cfc8f on hv-cinder-81514 Aug 30 01:13:43.115397 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-e37fe3fa-5a86-4142-beca-9b9a05a505e9 req-f059a2fe-362c-4ce6-862c-aa35c15de0a6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037742 Aug 30 01:13:43.116195 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 516/1020] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:13:43.126039 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-5fe28e87-3e94-40f5-90db-8396074e97c6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Going to try to terminate instance {{(pid=120631) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:13:43.215884 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-5fe28e87-3e94-40f5-90db-8396074e97c6 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "DELETE /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 204 len: 0 microversion: 2.1 time: 0.140442 Aug 30 01:13:43.219517 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 505/1021] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:13:43 2022] DELETE /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:13:43.232944 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-ca416d38-ac0d-4c5d-a547-0aaa7c485586 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:43.233715 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-ca416d38-ac0d-4c5d-a547-0aaa7c485586 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:43.252095 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ca416d38-ac0d-4c5d-a547-0aaa7c485586 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:43.252643 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ca416d38-ac0d-4c5d-a547-0aaa7c485586 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:43.258973 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ca416d38-ac0d-4c5d-a547-0aaa7c485586 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:43.260642 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ca416d38-ac0d-4c5d-a547-0aaa7c485586 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:43.262983 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ca416d38-ac0d-4c5d-a547-0aaa7c485586 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:43.263445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ca416d38-ac0d-4c5d-a547-0aaa7c485586 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:43.409030 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-ca416d38-ac0d-4c5d-a547-0aaa7c485586 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:43.416773 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-ca416d38-ac0d-4c5d-a547-0aaa7c485586 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1569 microversion: 2.1 time: 0.195781 Aug 30 01:13:43.417366 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 517/1022] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:43 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:44.438791 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-1abcc6e7-76b9-4f93-813a-724af3303794 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:44.439519 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-1abcc6e7-76b9-4f93-813a-724af3303794 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:44.446024 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1abcc6e7-76b9-4f93-813a-724af3303794 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:44.446499 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1abcc6e7-76b9-4f93-813a-724af3303794 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:44.446931 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1abcc6e7-76b9-4f93-813a-724af3303794 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:44.447618 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1abcc6e7-76b9-4f93-813a-724af3303794 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:44.448067 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1abcc6e7-76b9-4f93-813a-724af3303794 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:44.448487 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-1abcc6e7-76b9-4f93-813a-724af3303794 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:44.623706 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-1abcc6e7-76b9-4f93-813a-724af3303794 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:44.631593 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-1abcc6e7-76b9-4f93-813a-724af3303794 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1569 microversion: 2.1 time: 0.197050 Aug 30 01:13:44.632170 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 506/1023] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:44 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:45.103090 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-c7bbea58-3315-4e79-8b95-a90c73454685 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aaebb727-7ee7-46b1-a0c2-e613ca31e215", "device": "/dev/sdb"}} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:45.106254 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-c7bbea58-3315-4e79-8b95-a90c73454685 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:45.112445 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c7bbea58-3315-4e79-8b95-a90c73454685 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:45.112926 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c7bbea58-3315-4e79-8b95-a90c73454685 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:45.113392 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c7bbea58-3315-4e79-8b95-a90c73454685 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:45.114085 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c7bbea58-3315-4e79-8b95-a90c73454685 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:45.114534 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c7bbea58-3315-4e79-8b95-a90c73454685 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:45.114967 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c7bbea58-3315-4e79-8b95-a90c73454685 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:45.376156 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-c7bbea58-3315-4e79-8b95-a90c73454685 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "POST /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276911 Aug 30 01:13:45.377019 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 518/1024] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 30 01:13:45 2022] POST /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:13:45.654043 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-a08a8417-0a40-4e7b-b207-1e27860e81e7 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:45.654743 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-a08a8417-0a40-4e7b-b207-1e27860e81e7 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:45.661729 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a08a8417-0a40-4e7b-b207-1e27860e81e7 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:45.662214 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a08a8417-0a40-4e7b-b207-1e27860e81e7 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:45.662843 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a08a8417-0a40-4e7b-b207-1e27860e81e7 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:45.663711 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a08a8417-0a40-4e7b-b207-1e27860e81e7 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:45.664161 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a08a8417-0a40-4e7b-b207-1e27860e81e7 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:45.664583 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-a08a8417-0a40-4e7b-b207-1e27860e81e7 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:45.729785 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-a08a8417-0a40-4e7b-b207-1e27860e81e7 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a84ede2a594f7ab23b442baa9f2f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4d639296c34f1dbf0b327fd0828620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:45.737725 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-a08a8417-0a40-4e7b-b207-1e27860e81e7 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 200 len: 1220 microversion: 2.1 time: 0.088474 Aug 30 01:13:45.738307 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 519/1025] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:45 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:13:45.750200 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-9ca9ddfa-aa6b-43c2-909a-0b94b21be569 req-a0141b0c-e278-443b-beaf-e48e9433eaf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c1fad5-fcbd-475a-b590-406d1b8cfc8f", "name": "network-vif-deleted", "tag": "f326f1cc-3214-4c94-b458-a90b5f3ea1e3"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:45.759520 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-9ca9ddfa-aa6b-43c2-909a-0b94b21be569 req-a0141b0c-e278-443b-beaf-e48e9433eaf1 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:45.760081 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-9ca9ddfa-aa6b-43c2-909a-0b94b21be569 req-a0141b0c-e278-443b-beaf-e48e9433eaf1 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:45.760507 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-9ca9ddfa-aa6b-43c2-909a-0b94b21be569 req-a0141b0c-e278-443b-beaf-e48e9433eaf1 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:45.771679 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-9ca9ddfa-aa6b-43c2-909a-0b94b21be569 req-a0141b0c-e278-443b-beaf-e48e9433eaf1 service nova] Creating event network-vif-deleted:f326f1cc-3214-4c94-b458-a90b5f3ea1e3 for instance 77c1fad5-fcbd-475a-b590-406d1b8cfc8f on hv-cinder-81514 Aug 30 01:13:45.776541 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-9ca9ddfa-aa6b-43c2-909a-0b94b21be569 req-a0141b0c-e278-443b-beaf-e48e9433eaf1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161204 Aug 30 01:13:45.777153 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 507/1026] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:13:46.759279 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-753702f2-e7c0-499a-9fda-35c5550d721a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:46.759807 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-753702f2-e7c0-499a-9fda-35c5550d721a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] [instance: 77c1fad5-fcbd-475a-b590-406d1b8cfc8f] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:46.767079 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-753702f2-e7c0-499a-9fda-35c5550d721a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:46.767565 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-753702f2-e7c0-499a-9fda-35c5550d721a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:46.768008 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-753702f2-e7c0-499a-9fda-35c5550d721a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:46.768705 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-753702f2-e7c0-499a-9fda-35c5550d721a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:46.769196 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-753702f2-e7c0-499a-9fda-35c5550d721a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:46.769628 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-753702f2-e7c0-499a-9fda-35c5550d721a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:46.783653 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-753702f2-e7c0-499a-9fda-35c5550d721a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] HTTP exception thrown: Instance 77c1fad5-fcbd-475a-b590-406d1b8cfc8f could not be found. Aug 30 01:13:46.785329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-753702f2-e7c0-499a-9fda-35c5550d721a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Request method failure captured: Aug 30 01:13:46.785329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f HTTP/1.1 Aug 30 01:13:46.785329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:13:46.785329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:13:46.785329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:13:46.785329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:13:46.785329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:13:46.785329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:13:46.785329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:13:46.785329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:13:46.785329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWMwPkcFV3SOxUo3gbCkSmeWlyHxMAs5VH3JZeHKEmNJ_9ZmyNulcVo79-itzsnUhsIOKiZQZeYMWd_qbvoitsbM4BM7ObUuAw65I8_DjjSh-4hYvZ6m_H2z6x2xMOUzUraljO1RCV934Uta0_6WOAefC4d9ntfOSm0BxBpYuZufLUM Aug 30 01:13:46.785329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:13:46.785329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:13:46.785329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:13:46.785329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:13:46.785329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:13:46.785329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:13:46.785329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: aa4d639296c34f1dbf0b327fd0828620 Aug 30 01:13:46.785329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-TestShelveInstance-1609559103 Aug 30 01:13:46.785329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:13:46.785329 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:13:46.787123 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aa4d639296c34f1dbf0b327fd0828620"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa4d639296c34f1dbf0b327fd0828620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aa4d639296c34f1dbf0b327fd0828620"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa4d639296c34f1dbf0b327fd0828620"}]}] Aug 30 01:13:46.787123 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-TestShelveInstance-1609559103 Aug 30 01:13:46.787123 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: aa4d639296c34f1dbf0b327fd0828620 Aug 30 01:13:46.787123 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-TestShelveInstance-1609559103 Aug 30 01:13:46.787123 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-TestShelveInstance-1609559103-project Aug 30 01:13:46.787123 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:13:46.787123 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:13:46.787123 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: 21a84ede2a594f7ab23b442baa9f2f5a Aug 30 01:13:46.787123 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-TestShelveInstance-1609559103-project Aug 30 01:13:46.787123 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:13:46.787123 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Instance 77c1fad5-fcbd-475a-b590-406d1b8cfc8f could not be found. Aug 30 01:13:46.787123 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': '77c1fad5-fcbd-475a-b590-406d1b8cfc8f'} Aug 30 01:13:46.788047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:13:46.788047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:13:46.788047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:13:46.788047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:13:46.788047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:13:46.788047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:13:46.788047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:13:46.788047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:13:46.788047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:13:46.788047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:13:46.788047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c1fad5-fcbd-475a-b590-406d1b8cfc8f could not be found. Aug 30 01:13:46.788047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:13:46.788047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:13:46.788047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:13:46.788047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:13:46.788047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:13:46.788047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:13:46.788047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:13:46.788047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:13:46.788047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:13:46.789671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:13:46.789671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:13:46.789671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:13:46.789671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:13:46.789671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:13:46.789671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:13:46.789671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:13:46.789671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c1fad5-fcbd-475a-b590-406d1b8cfc8f could not be found. Aug 30 01:13:46.789671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:13:46.789671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:13:46.789671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:13:46.789671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:13:46.789671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:13:46.789671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:13:46.789671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:13:46.789671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:13:46.789671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c1fad5-fcbd-475a-b590-406d1b8cfc8f could not be found. Aug 30 01:13:46.789671 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:13:46.791056 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-753702f2-e7c0-499a-9fda-35c5550d721a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Returning 404 to user: Instance 77c1fad5-fcbd-475a-b590-406d1b8cfc8f could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:13:46.791056 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-753702f2-e7c0-499a-9fda-35c5550d721a tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f" status: 404 len: 111 microversion: 2.1 time: 0.031445 Aug 30 01:13:46.791056 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 520/1027] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:46 2022] GET /compute/v2.1/servers/77c1fad5-fcbd-475a-b590-406d1b8cfc8f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:13:46.948508 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-452a4348-0bfb-4211-b995-a5af93db4607 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] Calling method '.version_select at 0x7f0f526e25e0>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:46.970067 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-452a4348-0bfb-4211-b995-a5af93db4607 tempest-TestShelveInstance-1609559103 tempest-TestShelveInstance-1609559103-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1664379396" status: 202 len: 0 microversion: 2.1 time: 0.025645 Aug 30 01:13:46.970651 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 508/1028] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Aug 30 01:13:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1664379396 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:14:07.100085 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-c65a623e-a61f-4e8a-986f-46265d3f77c6 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:07.100586 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-c65a623e-a61f-4e8a-986f-46265d3f77c6 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:07.103158 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=10 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:07.103794 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:07.110220 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c65a623e-a61f-4e8a-986f-46265d3f77c6 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:07.110731 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c65a623e-a61f-4e8a-986f-46265d3f77c6 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:07.111163 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c65a623e-a61f-4e8a-986f-46265d3f77c6 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:07.111847 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c65a623e-a61f-4e8a-986f-46265d3f77c6 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:07.112297 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c65a623e-a61f-4e8a-986f-46265d3f77c6 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:07.112719 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-c65a623e-a61f-4e8a-986f-46265d3f77c6 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:07.197481 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.objects.instance [None req-c65a623e-a61f-4e8a-986f-46265d3f77c6 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lazy-loading 'services' on Instance uuid d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd {{(pid=120630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:14:07.268968 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-c65a623e-a61f-4e8a-986f-46265d3f77c6 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd/os-volume_attachments/aaebb727-7ee7-46b1-a0c2-e613ca31e215" status: 202 len: 0 microversion: 2.1 time: 0.172665 Aug 30 01:14:07.269647 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 521/1029] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 30 01:14:07 2022] DELETE /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd/os-volume_attachments/aaebb727-7ee7-46b1-a0c2-e613ca31e215 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:14:08.388743 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:08.389539 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:08.393370 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-24d64c2c-dc53-4c26-a8de-f7f40bcd0fee tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:08.393958 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-24d64c2c-dc53-4c26-a8de-f7f40bcd0fee tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:08.402079 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-24d64c2c-dc53-4c26-a8de-f7f40bcd0fee tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:08.402568 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-24d64c2c-dc53-4c26-a8de-f7f40bcd0fee tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:08.404104 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-24d64c2c-dc53-4c26-a8de-f7f40bcd0fee tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:08.404824 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-24d64c2c-dc53-4c26-a8de-f7f40bcd0fee tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:08.405332 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-24d64c2c-dc53-4c26-a8de-f7f40bcd0fee tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:08.405770 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-24d64c2c-dc53-4c26-a8de-f7f40bcd0fee tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:08.433246 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-24d64c2c-dc53-4c26-a8de-f7f40bcd0fee tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd] Going to try to terminate instance {{(pid=120631) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:14:08.507085 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-24d64c2c-dc53-4c26-a8de-f7f40bcd0fee tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd" status: 204 len: 0 microversion: 2.1 time: 0.119890 Aug 30 01:14:08.508023 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 509/1030] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:14:08 2022] DELETE /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:14:08.518587 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-1aa0c0fc-b18c-4f23-8d20-1d90e5f3327e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:08.519210 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-1aa0c0fc-b18c-4f23-8d20-1d90e5f3327e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:08.525574 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1aa0c0fc-b18c-4f23-8d20-1d90e5f3327e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:08.526059 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1aa0c0fc-b18c-4f23-8d20-1d90e5f3327e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:08.526498 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1aa0c0fc-b18c-4f23-8d20-1d90e5f3327e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:08.527184 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1aa0c0fc-b18c-4f23-8d20-1d90e5f3327e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:08.527690 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1aa0c0fc-b18c-4f23-8d20-1d90e5f3327e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:08.529254 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1aa0c0fc-b18c-4f23-8d20-1d90e5f3327e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:08.660718 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-1aa0c0fc-b18c-4f23-8d20-1d90e5f3327e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:08.668570 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-1aa0c0fc-b18c-4f23-8d20-1d90e5f3327e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd" status: 200 len: 1514 microversion: 2.1 time: 0.156284 Aug 30 01:14:08.669717 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 522/1031] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:08 2022] GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:09.691411 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-f4ddf06b-d5eb-425d-b1d2-fe67108cc733 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:09.692113 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-f4ddf06b-d5eb-425d-b1d2-fe67108cc733 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:09.698454 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f4ddf06b-d5eb-425d-b1d2-fe67108cc733 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:09.698937 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f4ddf06b-d5eb-425d-b1d2-fe67108cc733 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:09.699364 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f4ddf06b-d5eb-425d-b1d2-fe67108cc733 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:09.700831 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f4ddf06b-d5eb-425d-b1d2-fe67108cc733 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:09.701307 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f4ddf06b-d5eb-425d-b1d2-fe67108cc733 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:09.701731 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-f4ddf06b-d5eb-425d-b1d2-fe67108cc733 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:09.832295 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-f4ddf06b-d5eb-425d-b1d2-fe67108cc733 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:09.840042 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-f4ddf06b-d5eb-425d-b1d2-fe67108cc733 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd" status: 200 len: 1514 microversion: 2.1 time: 0.152976 Aug 30 01:14:09.840683 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 510/1032] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:09 2022] GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:10.567983 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-fea09140-6d3d-4a17-b9eb-9c58af121b9e req-d282008c-d392-4543-90dc-d487f9a893cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd", "name": "network-vif-deleted", "tag": "c6bd4d4e-a659-4ec2-9e93-0883fee5477e"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:14:10.579236 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-fea09140-6d3d-4a17-b9eb-9c58af121b9e req-d282008c-d392-4543-90dc-d487f9a893cd service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:10.579718 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-fea09140-6d3d-4a17-b9eb-9c58af121b9e req-d282008c-d392-4543-90dc-d487f9a893cd service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:10.580152 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-fea09140-6d3d-4a17-b9eb-9c58af121b9e req-d282008c-d392-4543-90dc-d487f9a893cd service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:10.592040 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-fea09140-6d3d-4a17-b9eb-9c58af121b9e req-d282008c-d392-4543-90dc-d487f9a893cd service nova] Creating event network-vif-deleted:c6bd4d4e-a659-4ec2-9e93-0883fee5477e for instance d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd on hv-cinder-81514 Aug 30 01:14:10.596824 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-fea09140-6d3d-4a17-b9eb-9c58af121b9e req-d282008c-d392-4543-90dc-d487f9a893cd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032514 Aug 30 01:14:10.597449 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 523/1033] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:14:10.860437 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-bb71060c-b9de-4b86-9ac4-bad52eb672ac tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:10.861049 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-bb71060c-b9de-4b86-9ac4-bad52eb672ac tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:10.867439 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-bb71060c-b9de-4b86-9ac4-bad52eb672ac tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:10.867918 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-bb71060c-b9de-4b86-9ac4-bad52eb672ac tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:10.868345 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-bb71060c-b9de-4b86-9ac4-bad52eb672ac tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:10.869031 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-bb71060c-b9de-4b86-9ac4-bad52eb672ac tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:10.869500 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-bb71060c-b9de-4b86-9ac4-bad52eb672ac tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:10.869916 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-bb71060c-b9de-4b86-9ac4-bad52eb672ac tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:10.901488 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-bb71060c-b9de-4b86-9ac4-bad52eb672ac tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:10.901961 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-bb71060c-b9de-4b86-9ac4-bad52eb672ac tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:10.902387 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-bb71060c-b9de-4b86-9ac4-bad52eb672ac tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:10.902899 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.objects.instance [None req-bb71060c-b9de-4b86-9ac4-bad52eb672ac tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lazy-loading 'fault' on Instance uuid d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd {{(pid=120631) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:14:10.944142 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-bb71060c-b9de-4b86-9ac4-bad52eb672ac tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:10.954063 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-bb71060c-b9de-4b86-9ac4-bad52eb672ac tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd" status: 200 len: 1309 microversion: 2.1 time: 0.097374 Aug 30 01:14:10.954724 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 511/1034] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:10 2022] GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:11.990603 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-1f22adf1-3cd0-483f-a9e7-951ade6ec446 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:11.991239 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-1f22adf1-3cd0-483f-a9e7-951ade6ec446 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:11.997819 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1f22adf1-3cd0-483f-a9e7-951ade6ec446 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:11.998299 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1f22adf1-3cd0-483f-a9e7-951ade6ec446 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:11.998871 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1f22adf1-3cd0-483f-a9e7-951ade6ec446 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:11.999559 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1f22adf1-3cd0-483f-a9e7-951ade6ec446 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:12.000007 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1f22adf1-3cd0-483f-a9e7-951ade6ec446 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:12.000429 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-1f22adf1-3cd0-483f-a9e7-951ade6ec446 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:12.013980 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-1f22adf1-3cd0-483f-a9e7-951ade6ec446 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] HTTP exception thrown: Instance d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd could not be found. Aug 30 01:14:12.015575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-1f22adf1-3cd0-483f-a9e7-951ade6ec446 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Request method failure captured: Aug 30 01:14:12.015575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd HTTP/1.1 Aug 30 01:14:12.015575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:14:12.015575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:14:12.015575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:14:12.015575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:14:12.015575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:14:12.015575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:14:12.015575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:14:12.015575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:14:12.015575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWQrofN9-Dr6CIZg0Kne02rpsr5MeDWXUmrUU4KiuNMW9UoMhHuMBnj2YQL5ZYcgcubrk8bCzRLFDOIkOFEh11cgHAlD4JJsCV9aDKNnrXVY9sxZg1lqgJSfIS8iTBX3Tz3pAlfbhEcGYVlnVL-9IZzv8r268RiNKorXnbtWJ-jLxOk Aug 30 01:14:12.015575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:14:12.015575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:14:12.015575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:14:12.015575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:14:12.015575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:14:12.015575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:14:12.015575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: 0fc156b7a56e4ecc999a85d59bd008b3 Aug 30 01:14:12.015575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1108241488 Aug 30 01:14:12.015575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:14:12.015575 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:14:12.017285 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0fc156b7a56e4ecc999a85d59bd008b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0fc156b7a56e4ecc999a85d59bd008b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0fc156b7a56e4ecc999a85d59bd008b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0fc156b7a56e4ecc999a85d59bd008b3"}]}] Aug 30 01:14:12.017285 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-VolumesSnapshotTestJSON-1108241488 Aug 30 01:14:12.017285 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: 0fc156b7a56e4ecc999a85d59bd008b3 Aug 30 01:14:12.017285 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1108241488 Aug 30 01:14:12.017285 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-VolumesSnapshotTestJSON-1108241488-project Aug 30 01:14:12.017285 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:14:12.017285 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:14:12.017285 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: 1df3f20605ad4ccfaefddb64cec11875 Aug 30 01:14:12.017285 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-VolumesSnapshotTestJSON-1108241488-project Aug 30 01:14:12.017285 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:14:12.017285 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Instance d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd could not be found. Aug 30 01:14:12.017285 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': 'd7bfe5dd-8636-4843-a21f-be4b1d2e5bcd'} Aug 30 01:14:12.018209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:14:12.018209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:14:12.018209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:14:12.018209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:14:12.018209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:14:12.018209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:14:12.018209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:14:12.018209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:14:12.018209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:14:12.018209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:14:12.018209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd could not be found. Aug 30 01:14:12.018209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:14:12.018209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:14:12.018209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:14:12.018209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:14:12.018209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:14:12.018209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:14:12.018209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:14:12.018209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:14:12.018209 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:14:12.019567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:14:12.019567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:14:12.019567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:14:12.019567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:14:12.019567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:14:12.019567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:14:12.019567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:14:12.019567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd could not be found. Aug 30 01:14:12.019567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:14:12.019567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:14:12.019567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:14:12.019567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:14:12.019567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:14:12.019567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:14:12.019567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:14:12.019567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:14:12.019567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd could not be found. Aug 30 01:14:12.019567 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:14:12.020741 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-1f22adf1-3cd0-483f-a9e7-951ade6ec446 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Returning 404 to user: Instance d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:14:12.020741 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-1f22adf1-3cd0-483f-a9e7-951ade6ec446 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd" status: 404 len: 111 microversion: 2.1 time: 0.031091 Aug 30 01:14:12.020741 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 524/1035] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:11 2022] GET /compute/v2.1/servers/d7bfe5dd-8636-4843-a21f-be4b1d2e5bcd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:14:19.849431 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-dc01e0f8-c48e-4008-8b78-2314157ed425 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1547937603", "imageRef": "d6c817b5-c41c-4210-a963-172386e2e582", "flavorRef": "452", "networks": [{"uuid": "c5fbd515-25c8-49cc-a7b1-48bf5db47f27"}]}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:14:19.904240 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.network.neutron [None req-dc01e0f8-c48e-4008-8b78-2314157ed425 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] validate_networks() for [('c5fbd515-25c8-49cc-a7b1-48bf5db47f27', None, None, None, None, None)] {{(pid=120631) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:14:20.251474 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-dc01e0f8-c48e-4008-8b78-2314157ed425 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Flavor limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:14:20.251942 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-dc01e0f8-c48e-4008-8b78-2314157ed425 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Image limits 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:14:20.252453 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-dc01e0f8-c48e-4008-8b78-2314157ed425 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Flavor pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:14:20.253265 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-dc01e0f8-c48e-4008-8b78-2314157ed425 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Image pref 0:0:0 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:14:20.253498 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.virt.hardware [None req-dc01e0f8-c48e-4008-8b78-2314157ed425 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120631) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:14:20.262385 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dc01e0f8-c48e-4008-8b78-2314157ed425 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:20.263252 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dc01e0f8-c48e-4008-8b78-2314157ed425 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:20.263744 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dc01e0f8-c48e-4008-8b78-2314157ed425 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:20.264425 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dc01e0f8-c48e-4008-8b78-2314157ed425 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:20.264879 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dc01e0f8-c48e-4008-8b78-2314157ed425 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:20.265340 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-dc01e0f8-c48e-4008-8b78-2314157ed425 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:20.282889 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-dc01e0f8-c48e-4008-8b78-2314157ed425 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Getting quotas for project 0fc156b7a56e4ecc999a85d59bd008b3. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:14:20.286814 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.quota [None req-dc01e0f8-c48e-4008-8b78-2314157ed425 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Getting quotas for user 1df3f20605ad4ccfaefddb64cec11875 and project 0fc156b7a56e4ecc999a85d59bd008b3. Resources: {'ram', 'instances', 'cores'} {{(pid=120631) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:14:20.298557 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-dc01e0f8-c48e-4008-8b78-2314157ed425 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Going to run 1 instances... {{(pid=120631) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:14:20.300855 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-dc01e0f8-c48e-4008-8b78-2314157ed425 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6c817b5-c41c-4210-a963-172386e2e582',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120631) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:14:20.346914 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-dc01e0f8-c48e-4008-8b78-2314157ed425 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.501294 Aug 30 01:14:20.347567 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 512/1036] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 30 01:14:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:14:20.358830 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-561efba3-527e-4bd3-8fc4-a67f40246c85 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:20.359446 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-561efba3-527e-4bd3-8fc4-a67f40246c85 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:20.417593 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-561efba3-527e-4bd3-8fc4-a67f40246c85 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:20.425149 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-561efba3-527e-4bd3-8fc4-a67f40246c85 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1" status: 200 len: 1219 microversion: 2.1 time: 0.070724 Aug 30 01:14:20.425709 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 525/1037] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:20 2022] GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:21.447475 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-dca60495-df6a-48d6-8e0e-485676f9e780 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:21.448111 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-dca60495-df6a-48d6-8e0e-485676f9e780 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:21.502114 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-dca60495-df6a-48d6-8e0e-485676f9e780 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:21.508963 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-dca60495-df6a-48d6-8e0e-485676f9e780 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1" status: 200 len: 1219 microversion: 2.1 time: 0.066764 Aug 30 01:14:21.509630 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 513/1038] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:21 2022] GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:22.531109 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-eecf8c8b-76d1-4efc-9e4b-c138d3ed4ec2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:22.531754 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-eecf8c8b-76d1-4efc-9e4b-c138d3ed4ec2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:22.534141 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:22.589579 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-eecf8c8b-76d1-4efc-9e4b-c138d3ed4ec2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:22.597338 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-eecf8c8b-76d1-4efc-9e4b-c138d3ed4ec2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1" status: 200 len: 1219 microversion: 2.1 time: 0.070863 Aug 30 01:14:22.597902 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 526/1039] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:22 2022] GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:23.617851 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0df92102-0141-4832-87d8-dfa86135557a tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:23.618481 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-0df92102-0141-4832-87d8-dfa86135557a tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:23.672438 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-0df92102-0141-4832-87d8-dfa86135557a tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:23.680555 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0df92102-0141-4832-87d8-dfa86135557a tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1" status: 200 len: 1219 microversion: 2.1 time: 0.066546 Aug 30 01:14:23.681392 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 514/1040] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:23 2022] GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:24.703617 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-76256939-ddfe-4bbb-a2e6-bf1f78ac4ca0 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:24.704280 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-76256939-ddfe-4bbb-a2e6-bf1f78ac4ca0 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:24.711878 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-76256939-ddfe-4bbb-a2e6-bf1f78ac4ca0 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:24.712365 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-76256939-ddfe-4bbb-a2e6-bf1f78ac4ca0 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:24.712892 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-76256939-ddfe-4bbb-a2e6-bf1f78ac4ca0 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:24.713854 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-76256939-ddfe-4bbb-a2e6-bf1f78ac4ca0 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:24.714312 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-76256939-ddfe-4bbb-a2e6-bf1f78ac4ca0 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:24.715073 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-76256939-ddfe-4bbb-a2e6-bf1f78ac4ca0 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:24.801371 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-76256939-ddfe-4bbb-a2e6-bf1f78ac4ca0 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:24.809407 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-76256939-ddfe-4bbb-a2e6-bf1f78ac4ca0 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1" status: 200 len: 1223 microversion: 2.1 time: 0.110558 Aug 30 01:14:24.821290 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 527/1041] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:24 2022] GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1 => generated 1223 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:25.832458 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-c619c351-0a03-4872-b9b0-3357fab26867 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:25.833511 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-c619c351-0a03-4872-b9b0-3357fab26867 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:25.840586 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c619c351-0a03-4872-b9b0-3357fab26867 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:25.841096 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c619c351-0a03-4872-b9b0-3357fab26867 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:25.841541 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c619c351-0a03-4872-b9b0-3357fab26867 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:25.842242 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c619c351-0a03-4872-b9b0-3357fab26867 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:25.842832 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c619c351-0a03-4872-b9b0-3357fab26867 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:25.843392 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-c619c351-0a03-4872-b9b0-3357fab26867 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:25.913520 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-c619c351-0a03-4872-b9b0-3357fab26867 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:25.922414 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-c619c351-0a03-4872-b9b0-3357fab26867 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1" status: 200 len: 1277 microversion: 2.1 time: 0.094065 Aug 30 01:14:25.922989 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 515/1042] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:25 2022] GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1 => generated 1277 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:26.943059 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-e2a2168e-4a51-4a16-9452-6270b0e408b5 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:26.943674 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-e2a2168e-4a51-4a16-9452-6270b0e408b5 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:26.950740 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e2a2168e-4a51-4a16-9452-6270b0e408b5 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:26.951231 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e2a2168e-4a51-4a16-9452-6270b0e408b5 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:26.951658 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e2a2168e-4a51-4a16-9452-6270b0e408b5 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:26.952362 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e2a2168e-4a51-4a16-9452-6270b0e408b5 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:26.952818 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e2a2168e-4a51-4a16-9452-6270b0e408b5 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:26.953283 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-e2a2168e-4a51-4a16-9452-6270b0e408b5 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:26.992325 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [req-bd99b618-ebba-4646-a334-25308577af9a req-5c263039-7454-491f-9a08-81d690e1ee45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91e78577-82d3-4a1d-b757-3689a48473d1", "tag": "75ad9076-d6a4-4431-a439-0590e935394a"}]} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:14:27.004997 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-bd99b618-ebba-4646-a334-25308577af9a req-5c263039-7454-491f-9a08-81d690e1ee45 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:27.005515 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-bd99b618-ebba-4646-a334-25308577af9a req-5c263039-7454-491f-9a08-81d690e1ee45 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:27.005947 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [req-bd99b618-ebba-4646-a334-25308577af9a req-5c263039-7454-491f-9a08-81d690e1ee45 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:27.018618 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.compute.server_external_events [req-bd99b618-ebba-4646-a334-25308577af9a req-5c263039-7454-491f-9a08-81d690e1ee45 service nova] Creating event network-changed:75ad9076-d6a4-4431-a439-0590e935394a for instance 91e78577-82d3-4a1d-b757-3689a48473d1 on hv-cinder-81514 Aug 30 01:14:27.023449 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [req-bd99b618-ebba-4646-a334-25308577af9a req-5c263039-7454-491f-9a08-81d690e1ee45 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035018 Aug 30 01:14:27.024489 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 516/1043] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:14:27.103109 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-e2a2168e-4a51-4a16-9452-6270b0e408b5 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:27.112142 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-e2a2168e-4a51-4a16-9452-6270b0e408b5 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1" status: 200 len: 1319 microversion: 2.1 time: 0.172953 Aug 30 01:14:27.112713 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 528/1044] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:26 2022] GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:28.133822 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-efeaa4c2-fc6e-4ec6-a936-91e3d118070e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:28.134523 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-efeaa4c2-fc6e-4ec6-a936-91e3d118070e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:28.141280 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-efeaa4c2-fc6e-4ec6-a936-91e3d118070e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:28.141767 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-efeaa4c2-fc6e-4ec6-a936-91e3d118070e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:28.142207 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-efeaa4c2-fc6e-4ec6-a936-91e3d118070e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:28.142911 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-efeaa4c2-fc6e-4ec6-a936-91e3d118070e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:28.143365 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-efeaa4c2-fc6e-4ec6-a936-91e3d118070e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:28.143790 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-efeaa4c2-fc6e-4ec6-a936-91e3d118070e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:28.280591 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-efeaa4c2-fc6e-4ec6-a936-91e3d118070e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:28.289053 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-efeaa4c2-fc6e-4ec6-a936-91e3d118070e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1" status: 200 len: 1319 microversion: 2.1 time: 0.159930 Aug 30 01:14:28.289788 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 517/1045] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:28 2022] GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:29.311044 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-29cd6753-3af6-4cb3-96db-14a213436964 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:29.311693 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-29cd6753-3af6-4cb3-96db-14a213436964 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:29.318823 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-29cd6753-3af6-4cb3-96db-14a213436964 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:29.319308 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-29cd6753-3af6-4cb3-96db-14a213436964 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:29.319743 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-29cd6753-3af6-4cb3-96db-14a213436964 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:29.320437 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-29cd6753-3af6-4cb3-96db-14a213436964 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:29.320942 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-29cd6753-3af6-4cb3-96db-14a213436964 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:29.321362 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-29cd6753-3af6-4cb3-96db-14a213436964 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:29.451582 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-29cd6753-3af6-4cb3-96db-14a213436964 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:29.459304 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-29cd6753-3af6-4cb3-96db-14a213436964 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1" status: 200 len: 1319 microversion: 2.1 time: 0.152664 Aug 30 01:14:29.459870 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 529/1046] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:29 2022] GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:30.480543 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-8a6b9edf-94cd-4b36-98b8-56fe12ddbdc8 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:30.481206 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-8a6b9edf-94cd-4b36-98b8-56fe12ddbdc8 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:30.483601 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=2 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:30.489448 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8a6b9edf-94cd-4b36-98b8-56fe12ddbdc8 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:30.489943 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8a6b9edf-94cd-4b36-98b8-56fe12ddbdc8 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:30.490380 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8a6b9edf-94cd-4b36-98b8-56fe12ddbdc8 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:30.491101 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8a6b9edf-94cd-4b36-98b8-56fe12ddbdc8 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:30.491555 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8a6b9edf-94cd-4b36-98b8-56fe12ddbdc8 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:30.497950 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-8a6b9edf-94cd-4b36-98b8-56fe12ddbdc8 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:30.619086 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-8a6b9edf-94cd-4b36-98b8-56fe12ddbdc8 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:30.626935 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-8a6b9edf-94cd-4b36-98b8-56fe12ddbdc8 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1" status: 200 len: 1319 microversion: 2.1 time: 0.150231 Aug 30 01:14:30.627499 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 518/1047] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:30 2022] GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:31.648323 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-bdab3a40-8138-4f4e-8f65-3716c49e6fdf tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:31.649313 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-bdab3a40-8138-4f4e-8f65-3716c49e6fdf tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:31.656273 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bdab3a40-8138-4f4e-8f65-3716c49e6fdf tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:31.656821 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bdab3a40-8138-4f4e-8f65-3716c49e6fdf tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:31.657294 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bdab3a40-8138-4f4e-8f65-3716c49e6fdf tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:31.658060 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bdab3a40-8138-4f4e-8f65-3716c49e6fdf tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:31.658512 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bdab3a40-8138-4f4e-8f65-3716c49e6fdf tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:31.658939 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-bdab3a40-8138-4f4e-8f65-3716c49e6fdf tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:31.796120 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-bdab3a40-8138-4f4e-8f65-3716c49e6fdf tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:31.805551 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-bdab3a40-8138-4f4e-8f65-3716c49e6fdf tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1" status: 200 len: 1319 microversion: 2.1 time: 0.161076 Aug 30 01:14:31.806117 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 530/1048] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:31 2022] GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:32.828002 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-47d6ab50-52ad-4825-92b9-7ad1e529cea7 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:32.828619 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-47d6ab50-52ad-4825-92b9-7ad1e529cea7 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:32.835051 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-47d6ab50-52ad-4825-92b9-7ad1e529cea7 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:32.835533 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-47d6ab50-52ad-4825-92b9-7ad1e529cea7 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:32.835969 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-47d6ab50-52ad-4825-92b9-7ad1e529cea7 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:32.836665 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-47d6ab50-52ad-4825-92b9-7ad1e529cea7 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:32.837146 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-47d6ab50-52ad-4825-92b9-7ad1e529cea7 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:32.837575 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-47d6ab50-52ad-4825-92b9-7ad1e529cea7 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:32.967032 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-47d6ab50-52ad-4825-92b9-7ad1e529cea7 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:32.974585 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-47d6ab50-52ad-4825-92b9-7ad1e529cea7 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1" status: 200 len: 1319 microversion: 2.1 time: 0.152208 Aug 30 01:14:32.975142 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 519/1049] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:32 2022] GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:33.172815 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-1c1b55fa-e65d-46fa-ac16-3cff341a6c4a req-2c57daa5-3459-40cc-9486-31e339217ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e78577-82d3-4a1d-b757-3689a48473d1", "name": "network-vif-plugged", "status": "completed", "tag": "75ad9076-d6a4-4431-a439-0590e935394a"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:14:33.179335 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell0:SELECT=4 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:33.186053 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-1c1b55fa-e65d-46fa-ac16-3cff341a6c4a req-2c57daa5-3459-40cc-9486-31e339217ea2 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:33.186542 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-1c1b55fa-e65d-46fa-ac16-3cff341a6c4a req-2c57daa5-3459-40cc-9486-31e339217ea2 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:33.186976 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-1c1b55fa-e65d-46fa-ac16-3cff341a6c4a req-2c57daa5-3459-40cc-9486-31e339217ea2 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:33.198275 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-1c1b55fa-e65d-46fa-ac16-3cff341a6c4a req-2c57daa5-3459-40cc-9486-31e339217ea2 service nova] Creating event network-vif-plugged:75ad9076-d6a4-4431-a439-0590e935394a for instance 91e78577-82d3-4a1d-b757-3689a48473d1 on hv-cinder-81514 Aug 30 01:14:33.204703 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-1c1b55fa-e65d-46fa-ac16-3cff341a6c4a req-2c57daa5-3459-40cc-9486-31e339217ea2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035962 Aug 30 01:14:33.205497 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 531/1050] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:14:33.995379 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-64cdd479-c5be-4834-b8a5-87ec8001491b tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:33.995927 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-64cdd479-c5be-4834-b8a5-87ec8001491b tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:33.997928 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell0:SELECT=10 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:34.004213 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-64cdd479-c5be-4834-b8a5-87ec8001491b tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:34.004699 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-64cdd479-c5be-4834-b8a5-87ec8001491b tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:34.005162 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-64cdd479-c5be-4834-b8a5-87ec8001491b tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:34.005864 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-64cdd479-c5be-4834-b8a5-87ec8001491b tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:34.006320 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-64cdd479-c5be-4834-b8a5-87ec8001491b tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:34.006747 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-64cdd479-c5be-4834-b8a5-87ec8001491b tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:34.142103 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-64cdd479-c5be-4834-b8a5-87ec8001491b tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:34.150076 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-64cdd479-c5be-4834-b8a5-87ec8001491b tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1" status: 200 len: 1319 microversion: 2.1 time: 0.158704 Aug 30 01:14:34.150646 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 520/1051] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:33 2022] GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:35.172813 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-830897b7-2c29-41cc-99e9-dc9034c54fa6 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:35.173543 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-830897b7-2c29-41cc-99e9-dc9034c54fa6 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:35.179655 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-830897b7-2c29-41cc-99e9-dc9034c54fa6 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:35.180131 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-830897b7-2c29-41cc-99e9-dc9034c54fa6 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:35.180564 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-830897b7-2c29-41cc-99e9-dc9034c54fa6 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:35.181284 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-830897b7-2c29-41cc-99e9-dc9034c54fa6 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:35.181739 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-830897b7-2c29-41cc-99e9-dc9034c54fa6 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:35.182164 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-830897b7-2c29-41cc-99e9-dc9034c54fa6 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:35.311999 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-830897b7-2c29-41cc-99e9-dc9034c54fa6 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:35.319870 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-830897b7-2c29-41cc-99e9-dc9034c54fa6 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1" status: 200 len: 1508 microversion: 2.1 time: 0.152849 Aug 30 01:14:35.320434 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 532/1052] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:35 2022] GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:35.340041 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-7f973a31-37e9-41c2-afc7-8204e80db35e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "884c1ab9-bb17-477c-911a-f9d184a1cc23", "device": "/dev/sdb"}} {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:14:35.344322 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-7f973a31-37e9-41c2-afc7-8204e80db35e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:35.350822 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7f973a31-37e9-41c2-afc7-8204e80db35e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:35.351313 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7f973a31-37e9-41c2-afc7-8204e80db35e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:35.351754 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7f973a31-37e9-41c2-afc7-8204e80db35e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:35.352454 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7f973a31-37e9-41c2-afc7-8204e80db35e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:35.352904 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7f973a31-37e9-41c2-afc7-8204e80db35e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:35.353347 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-7f973a31-37e9-41c2-afc7-8204e80db35e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:35.584633 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-7f973a31-37e9-41c2-afc7-8204e80db35e tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "POST /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248464 Aug 30 01:14:35.585275 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 521/1053] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 30 01:14:35 2022] POST /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:14:53.870951 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-d0718b68-204a-4b25-b24c-072ba5d3c5c8 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:53.871459 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-d0718b68-204a-4b25-b24c-072ba5d3c5c8 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:53.874206 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_api:SELECT=28 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:53.874863 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG dbcounter [-] [120630] Writing DB stats nova_cell1:SELECT=32 {{(pid=120630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:53.880519 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d0718b68-204a-4b25-b24c-072ba5d3c5c8 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:53.881008 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d0718b68-204a-4b25-b24c-072ba5d3c5c8 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:53.881478 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d0718b68-204a-4b25-b24c-072ba5d3c5c8 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:53.882173 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d0718b68-204a-4b25-b24c-072ba5d3c5c8 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:53.882631 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d0718b68-204a-4b25-b24c-072ba5d3c5c8 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:53.883064 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-d0718b68-204a-4b25-b24c-072ba5d3c5c8 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:53.967828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.objects.instance [None req-d0718b68-204a-4b25-b24c-072ba5d3c5c8 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lazy-loading 'services' on Instance uuid 91e78577-82d3-4a1d-b757-3689a48473d1 {{(pid=120630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:14:54.040197 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-d0718b68-204a-4b25-b24c-072ba5d3c5c8 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "DELETE /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1/os-volume_attachments/884c1ab9-bb17-477c-911a-f9d184a1cc23" status: 202 len: 0 microversion: 2.1 time: 0.173083 Aug 30 01:14:54.040863 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 533/1054] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 30 01:14:53 2022] DELETE /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1/os-volume_attachments/884c1ab9-bb17-477c-911a-f9d184a1cc23 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:14:55.159309 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:55.160074 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG dbcounter [-] [120631] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:55.164163 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-0210bc89-a9d3-49fd-99bd-7adb5e356c63 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:55.164744 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-0210bc89-a9d3-49fd-99bd-7adb5e356c63 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:55.172890 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0210bc89-a9d3-49fd-99bd-7adb5e356c63 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:55.173396 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0210bc89-a9d3-49fd-99bd-7adb5e356c63 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:55.173825 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0210bc89-a9d3-49fd-99bd-7adb5e356c63 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:55.174509 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0210bc89-a9d3-49fd-99bd-7adb5e356c63 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:55.174955 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0210bc89-a9d3-49fd-99bd-7adb5e356c63 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:55.175371 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-0210bc89-a9d3-49fd-99bd-7adb5e356c63 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:55.201829 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-0210bc89-a9d3-49fd-99bd-7adb5e356c63 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] Going to try to terminate instance {{(pid=120631) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:14:55.279999 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-0210bc89-a9d3-49fd-99bd-7adb5e356c63 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "DELETE /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1" status: 204 len: 0 microversion: 2.1 time: 0.121144 Aug 30 01:14:55.280630 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 522/1055] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 30 01:14:55 2022] DELETE /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:14:55.289367 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-ed5e9600-b0b1-4d82-840e-36e299aa73fd tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:55.290153 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-ed5e9600-b0b1-4d82-840e-36e299aa73fd tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:55.297426 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ed5e9600-b0b1-4d82-840e-36e299aa73fd tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:55.297914 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ed5e9600-b0b1-4d82-840e-36e299aa73fd tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:55.298349 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ed5e9600-b0b1-4d82-840e-36e299aa73fd tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:55.299042 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ed5e9600-b0b1-4d82-840e-36e299aa73fd tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:55.299493 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ed5e9600-b0b1-4d82-840e-36e299aa73fd tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:55.299922 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-ed5e9600-b0b1-4d82-840e-36e299aa73fd tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:55.432828 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.policy [None req-ed5e9600-b0b1-4d82-840e-36e299aa73fd tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120630) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:55.441200 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-ed5e9600-b0b1-4d82-840e-36e299aa73fd tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1" status: 200 len: 1514 microversion: 2.1 time: 0.155956 Aug 30 01:14:55.441769 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 534/1056] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:55 2022] GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:56.463062 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-5143ca2c-7c67-4a52-8119-d5bc92eb05b2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:56.463792 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-5143ca2c-7c67-4a52-8119-d5bc92eb05b2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:56.470665 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5143ca2c-7c67-4a52-8119-d5bc92eb05b2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:56.471140 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5143ca2c-7c67-4a52-8119-d5bc92eb05b2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:56.471570 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5143ca2c-7c67-4a52-8119-d5bc92eb05b2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:56.472251 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5143ca2c-7c67-4a52-8119-d5bc92eb05b2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:56.472699 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5143ca2c-7c67-4a52-8119-d5bc92eb05b2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:56.473144 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-5143ca2c-7c67-4a52-8119-d5bc92eb05b2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:56.607736 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-5143ca2c-7c67-4a52-8119-d5bc92eb05b2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:56.615536 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-5143ca2c-7c67-4a52-8119-d5bc92eb05b2 tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1" status: 200 len: 1514 microversion: 2.1 time: 0.156695 Aug 30 01:14:56.616102 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 523/1057] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:56 2022] GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:57.426949 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [req-8589cefb-a89f-4e01-a84b-8743c62be21b req-9452fa2d-5f24-4064-a179-ff134ef032e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e78577-82d3-4a1d-b757-3689a48473d1", "name": "network-vif-deleted", "tag": "75ad9076-d6a4-4431-a439-0590e935394a"}]} {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:14:57.437818 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-8589cefb-a89f-4e01-a84b-8743c62be21b req-9452fa2d-5f24-4064-a179-ff134ef032e9 service nova] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:57.438301 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-8589cefb-a89f-4e01-a84b-8743c62be21b req-9452fa2d-5f24-4064-a179-ff134ef032e9 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:57.438738 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [req-8589cefb-a89f-4e01-a84b-8743c62be21b req-9452fa2d-5f24-4064-a179-ff134ef032e9 service nova] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:57.450486 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.compute.server_external_events [req-8589cefb-a89f-4e01-a84b-8743c62be21b req-9452fa2d-5f24-4064-a179-ff134ef032e9 service nova] Creating event network-vif-deleted:75ad9076-d6a4-4431-a439-0590e935394a for instance 91e78577-82d3-4a1d-b757-3689a48473d1 on hv-cinder-81514 Aug 30 01:14:57.455434 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [req-8589cefb-a89f-4e01-a84b-8743c62be21b req-9452fa2d-5f24-4064-a179-ff134ef032e9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032119 Aug 30 01:14:57.456032 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 535/1058] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 30 01:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:14:57.636968 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.api.openstack.wsgi [None req-95b3244c-cc88-4e45-b50f-ad1919c7e36f tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120631) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:57.637661 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.compute.api [None req-95b3244c-cc88-4e45-b50f-ad1919c7e36f tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] Fetching instance by UUID {{(pid=120631) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:57.644348 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-95b3244c-cc88-4e45-b50f-ad1919c7e36f tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:57.644824 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-95b3244c-cc88-4e45-b50f-ad1919c7e36f tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:57.645298 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-95b3244c-cc88-4e45-b50f-ad1919c7e36f tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:57.645989 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-95b3244c-cc88-4e45-b50f-ad1919c7e36f tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:57.646437 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-95b3244c-cc88-4e45-b50f-ad1919c7e36f tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:57.646874 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-95b3244c-cc88-4e45-b50f-ad1919c7e36f tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:57.678280 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-95b3244c-cc88-4e45-b50f-ad1919c7e36f tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:57.678752 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-95b3244c-cc88-4e45-b50f-ad1919c7e36f tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:57.679179 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG oslo_concurrency.lockutils [None req-95b3244c-cc88-4e45-b50f-ad1919c7e36f tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120631) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:57.679616 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.objects.instance [None req-95b3244c-cc88-4e45-b50f-ad1919c7e36f tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lazy-loading 'fault' on Instance uuid 91e78577-82d3-4a1d-b757-3689a48473d1 {{(pid=120631) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:14:57.721479 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: DEBUG nova.policy [None req-95b3244c-cc88-4e45-b50f-ad1919c7e36f tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df3f20605ad4ccfaefddb64cec11875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc156b7a56e4ecc999a85d59bd008b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120631) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:57.729031 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: INFO nova.api.openstack.requestlog [None req-95b3244c-cc88-4e45-b50f-ad1919c7e36f tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1" status: 200 len: 1309 microversion: 2.1 time: 0.095928 Aug 30 01:14:57.729615 dv-cinder-815146-13-iscsi devstack@n-api.service[120631]: [pid: 120631|app: 0|req: 524/1059] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:57 2022] GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:58.748678 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 01:14:58.749299 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Tue Aug 30 01:14:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1 (ip 10.222.0.78) !!! Aug 30 01:14:58.753707 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-0ac1e9de-3d54-4875-90c4-8c9ab5659bbe tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Calling method '>' {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:58.754405 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.compute.api [None req-0ac1e9de-3d54-4875-90c4-8c9ab5659bbe tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] [instance: 91e78577-82d3-4a1d-b757-3689a48473d1] Fetching instance by UUID {{(pid=120630) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:58.762047 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0ac1e9de-3d54-4875-90c4-8c9ab5659bbe tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:58.763160 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0ac1e9de-3d54-4875-90c4-8c9ab5659bbe tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:58.763610 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0ac1e9de-3d54-4875-90c4-8c9ab5659bbe tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:58.764314 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0ac1e9de-3d54-4875-90c4-8c9ab5659bbe tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Acquiring lock "ded254c4-e178-4a36-b22b-4f767ea7accb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:58.764775 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0ac1e9de-3d54-4875-90c4-8c9ab5659bbe tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:58.765241 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG oslo_concurrency.lockutils [None req-0ac1e9de-3d54-4875-90c4-8c9ab5659bbe tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Lock "ded254c4-e178-4a36-b22b-4f767ea7accb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:58.780299 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.wsgi [None req-0ac1e9de-3d54-4875-90c4-8c9ab5659bbe tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] HTTP exception thrown: Instance 91e78577-82d3-4a1d-b757-3689a48473d1 could not be found. Aug 30 01:14:58.782000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-0ac1e9de-3d54-4875-90c4-8c9ab5659bbe tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Request method failure captured: Aug 30 01:14:58.782000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: request: GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1 HTTP/1.1 Aug 30 01:14:58.782000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept: application/json Aug 30 01:14:58.782000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Accept-Encoding: identity Aug 30 01:14:58.782000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Connection: close Aug 30 01:14:58.782000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Length: 0 Aug 30 01:14:58.782000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Content-Type: application/json Aug 30 01:14:58.782000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Host: 10.222.0.78 Aug 30 01:14:58.782000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: Openstack-System-Scope: None Aug 30 01:14:58.782000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: User-Agent: python-urllib3/1.26.12 Aug 30 01:14:58.782000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Auth-Token: gAAAAABjDWQrofN9-Dr6CIZg0Kne02rpsr5MeDWXUmrUU4KiuNMW9UoMhHuMBnj2YQL5ZYcgcubrk8bCzRLFDOIkOFEh11cgHAlD4JJsCV9aDKNnrXVY9sxZg1lqgJSfIS8iTBX3Tz3pAlfbhEcGYVlnVL-9IZzv8r268RiNKorXnbtWJ-jLxOk Aug 30 01:14:58.782000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Id: None Aug 30 01:14:58.782000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Domain-Name: None Aug 30 01:14:58.782000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Identity-Status: Confirmed Aug 30 01:14:58.782000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Is-Admin-Project: True Aug 30 01:14:58.782000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Id: default Aug 30 01:14:58.782000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Domain-Name: Default Aug 30 01:14:58.782000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Id: 0fc156b7a56e4ecc999a85d59bd008b3 Aug 30 01:14:58.782000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1108241488 Aug 30 01:14:58.782000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Role: reader,member Aug 30 01:14:58.782000 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Roles: reader,member Aug 30 01:14:58.783729 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0fc156b7a56e4ecc999a85d59bd008b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0fc156b7a56e4ecc999a85d59bd008b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0fc156b7a56e4ecc999a85d59bd008b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0fc156b7a56e4ecc999a85d59bd008b3"}]}] Aug 30 01:14:58.783729 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant: tempest-VolumesSnapshotTestJSON-1108241488 Aug 30 01:14:58.783729 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Id: 0fc156b7a56e4ecc999a85d59bd008b3 Aug 30 01:14:58.783729 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1108241488 Aug 30 01:14:58.783729 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User: tempest-VolumesSnapshotTestJSON-1108241488-project Aug 30 01:14:58.783729 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Id: default Aug 30 01:14:58.783729 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Domain-Name: Default Aug 30 01:14:58.783729 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Id: 1df3f20605ad4ccfaefddb64cec11875 Aug 30 01:14:58.783729 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: X-User-Name: tempest-VolumesSnapshotTestJSON-1108241488-project Aug 30 01:14:58.783729 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: method: > Aug 30 01:14:58.783729 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: exception: Instance 91e78577-82d3-4a1d-b757-3689a48473d1 could not be found. Aug 30 01:14:58.783729 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: action_args: {'id': '91e78577-82d3-4a1d-b757-3689a48473d1'} Aug 30 01:14:58.784883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: {{(pid=120630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:14:58.784883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:14:58.784883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:14:58.784883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:14:58.784883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:14:58.784883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:14:58.784883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:14:58.784883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:14:58.784883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:14:58.784883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:14:58.784883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91e78577-82d3-4a1d-b757-3689a48473d1 could not be found. Aug 30 01:14:58.784883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:14:58.784883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:14:58.784883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:14:58.784883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:14:58.784883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:14:58.784883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:14:58.784883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:14:58.784883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:14:58.784883 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:14:58.786549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:14:58.786549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:14:58.786549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:14:58.786549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:14:58.786549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:14:58.786549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:14:58.786549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:14:58.786549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91e78577-82d3-4a1d-b757-3689a48473d1 could not be found. Aug 30 01:14:58.786549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:14:58.786549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:14:58.786549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:14:58.786549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:14:58.786549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:14:58.786549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:14:58.786549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:14:58.786549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:14:58.786549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91e78577-82d3-4a1d-b757-3689a48473d1 could not be found. Aug 30 01:14:58.786549 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: ERROR nova.api.openstack.wsgi Aug 30 01:14:58.788112 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: DEBUG nova.api.openstack.wsgi [None req-0ac1e9de-3d54-4875-90c4-8c9ab5659bbe tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] Returning 404 to user: Instance 91e78577-82d3-4a1d-b757-3689a48473d1 could not be found. {{(pid=120630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:14:58.788112 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: INFO nova.api.openstack.requestlog [None req-0ac1e9de-3d54-4875-90c4-8c9ab5659bbe tempest-VolumesSnapshotTestJSON-1108241488 tempest-VolumesSnapshotTestJSON-1108241488-project] 10.222.0.78 "GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1" status: 404 len: 111 microversion: 2.1 time: 0.036058 Aug 30 01:14:58.788112 dv-cinder-815146-13-iscsi devstack@n-api.service[120630]: [pid: 120630|app: 0|req: 536/1060] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:58 2022] GET /compute/v2.1/servers/91e78577-82d3-4a1d-b757-3689a48473d1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)